NeuenahrFlood Dataset and an Improved Human-in-the-Loop Strategy for Efficient Flood Water Segmentation

Kurzfassung

Effective disaster response during floods requires quick identification of flooded areas. The typical data source for identification is aerial Remote Sensing (RS) imagery, often inexpensive RGB drone images. Reliable flood water detection in RGB images is thus essential. However, detecting water in RGB flood imagery remains challenging, because water, mud, and soil appear similar. Moreover, the sheer volume of data makes manual analysis impractical. To automate water detection, Computer Vision (CV) and Deep Learning (DL) techniques are employed. To train DL methods labeled data are required. We introduce an improved human-in-the-loop strategy which creates labeled data consisting of pairs of RGB image and water mask from aerial RGB and Near-Infrared (NIR) imagery of the 2021 Bad Neuenahr flood. For our labeling strategy, we integrate the NIR data via a false-color representation. We then apply the Segment Anything Model 2.1 (SAM 2.1) on these false-color NIR representations. Because flooded regions have complex shapes, the initial results require manual refinement. By leveraging sparse prompts to identify water, these adjustments are less time-consuming compared to traditional methods. In this way, we improve upon a previous strategy proposed by the authors based on Ilastik. The final labeled RGB dataset serves to train DL models to detect flood water regions in RGB images without additional NIR information. As a result of the proposed labeling strategy, to foster further flood detection research, we provide NeuenahrFlood, an RGB labeled dataset for the task of water segmentation in RGB images. NeuenahrFlood matches typical acquisition parameters during a river flooding event and adds to existing data resources with varied flood and vegetation patterns. We evaluate the benefit of the proposed labeling strategy by training state-of-the-art models on NeuenahrFlood and provide a baseline for further research, confirming the enhanced automated flood detection capabilities.