arXiv:2504.09066cs.CV2025-04被引 10

用灾前灾后街景图+预训练模型,精准评估局部灾害损失

Hyperlocal disaster damage assessment using bi-temporal street-view imagery and pre-trained vision models

  • 引入灾前街景作为无损基准,提升模型对损毁等级的判别能力
  • 双通道融合模型使损伤识别准确率从66.14%提升至77.11%
  • 适合应急响应、城市韧性规划等需要精细损毁评估的场景

街景图像因其能提供灾后视觉视角和地面细节,在灾害损毁评估中具有独特优势。尽管已有研究尝试分析灾后街景,但对时间序列街景的潜力仍挖掘不足。灾前图像可作为无损基准,帮助标注者客观标记灾后影响,提升数据集可靠性,并可能增强模型性能。本研究利用2024年飓风米尔顿前后佛罗里达州霍舍湾的双时相街景图像,结合预训练视觉模型(Swin Transformer与ConvNeXt)进行超局部损毁评估。目标包括:(1) 评估将灾前街景作为无损类别用于微调模型时的性能提升;(2) 设计并评估一种读取成对灾前灾后图像的双通道算法。结果表明,引入灾前图像并采用双通道特征融合框架显著提升评估精度:基于ConvNeXt的双通道模型准确率达77.11%,相较基准模型的66.14%有明显提升。该研究实现了高空间分辨率的快速灾损评估,为灾害管理与韧性规划提供决策支持。

原文摘要 · Abstract (English)

Street-view images offer unique advantages for disaster damage estimation as they capture impacts from a visual perspective and provide detailed, on-the-ground insights. Despite several investigations attempting to analyze street-view images for damage estimation, they mainly focus on post-disaster images. The potential of time-series street-view images remains underexplored. Pre-disaster images provide valuable benchmarks for accurate damage estimations at building and street levels. These images could aid annotators in objectively labeling post-disaster impacts, improving the reliability of labeled data sets for model training, and potentially enhancing the model performance in damage evaluation. The goal of this study is to estimate hyperlocal, on-the-ground disaster damages using bi-temporal street-view images and advanced pre-trained vision models. Street-view images before and after 2024 Hurricane Milton in Horseshoe Beach, Florida, were collected for experiments. The objectives are: (1) to assess the performance gains of incorporating pre-disaster street-view images as a no-damage category in fine-tuning pre-trained models, including Swin Transformer and ConvNeXt, for damage level classification; (2) to design and evaluate a dual-channel algorithm that reads pair-wise pre- and post-disaster street-view images for hyperlocal damage assessment. The results indicate that incorporating pre-disaster street-view images and employing a dual-channel processing framework can significantly enhance damage assessment accuracy. The accuracy improves from 66.14% with the Swin Transformer baseline to 77.11% with the dual-channel Feature-Fusion ConvNeXt model. This research enables rapid, operational damage assessments at hyperlocal spatial resolutions, providing valuable insights to support effective decision-making in disaster management and resilience planning.

灾害评估街景图像双通道模型预训练模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。