用预训练模型实现低空影像快速洪水制图,跨场景适应性强。
Flood Mapping from RGB imagery using a Vision Foundation Model

- 基于卫星预训练的视觉大模型微调,适配低空彩色影像洪水分割。
- 零样本迁移下性能超越现有方法,小样本微调后接近全量训练效果。
- 适合应急响应、灾害评估,尤其适用于数据稀缺的突发洪水场景。
及时获取高分辨率洪水覆盖范围地图对应急响应和灾情评估至关重要。本文采用低成本、快速采集的航空级RGB影像进行洪水制图。传统深度学习模型如CNN和小型视觉变换器需大量数据适应新场景。而预训练于卫星数据的视觉基础模型具备跨域泛化能力,但其空间分辨率、观测几何与正射RGB影像存在差异,需适应性调整。本文研究如何将卫星预训练的地球观测基础模型(Prithvi-EO-2.0-600M)适配至厘米级洪水水体分割任务。具体采用包含该视觉变压器与UPerNet解码器的Prithvi-2.0-UPN模型,在两个RGB洪水数据集(BlessemFlood21、NeuenahrFlood)上进行微调。实验表明:在各自数据集上微调后,该模型达到当前最优性能;在零样本迁移(以BlessemFlood21训练,测试于NeuenahrFlood)中优于现有基线模型;进一步引入少量NeuenahrFlood数据微调后,性能提升最快,几乎达到全量训练水平,验证了强迁移能力。
原文摘要 · Abstract (English)
Timely, high-resolution maps of flood extent around settlements are essential for emergency response and damage assessment. We consider airborne RGB imagery for flood mapping as it can be collected rapidly at low cost. To produce flood maps, deep learning models for water segmentation are often used. CNN based and small vision transformer models are used. However, they need much data for adaptation to a change of scenery, i.e., another flooding event. Vision foundation models or large vision transformers are known to generalize across domains. Recently, foundation models for Earth observation became available. They are pretrained on satellite data, whose spatial resolution, viewing geometry, and radiometry differ from nadir RGB imagery. Thus, adaptation is required. We investigate how a satellite-pretrained Earth observation foundation model can be adapted to centimeter-scale floodwater mapping from RGB imagery. Specifically, we fine-tune a model we call Prithvi-2.0-UPN consisting of the Prithvi-EO-2.0-600M Vision Transformer combined with a UPerNet decoder for binary water segmentation on two RGB datasets (BlessemFlood21, NeuenahrFlood). In a first experiment we observe that Prithvi-2.0-UPN reaches state-of-the-art results on BlessemFlood21 and NeuenahrFlood, when trained on their datasets. In a second experiment we show that Prithvi-2.0-UPN performs better than state-of-the-art baseline models for transfer to a new flood event (trained on BlessemFlood21, tested on NeuenahrFlood) in a zero-shot setting. However, the performance indicates room for improvement. In this respect, we investigate in a third experiment how performance improves when further fine-tuning the models with small shares of NeuenahrFlood training data: Prithvi-2.0-UPN improves the fastest and reaches almost the performance level when fully trained on NeuenahrFlood, indicating transfer capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。