arXiv:2606.21819cs.CV2026-06

无需微调,跨视角融合卫星与街景图实现可解释灾损评估

RAPID: A Reproducible Multi-Agent Pipeline for Interpretable Disaster Damage Assessment from Satellite and Street-View Imagery

论文配图:RAPID: A Reproducible Multi-Agent Pipeline for Interpretable Disaster Damage Assessment from Satellite and Street-View Imagery
图 1 · 摘自论文原文
  • 多智能体协同处理遥感与街景图像,实现跨视角理解
  • 零样本下多灾种分类准确率达0.92,跨视图损伤程度预测达0.627
  • 生成可解释报告,适合应急响应与灾后决策者使用

随着极端气候事件频发,亟需智能、可扩展且自主的灾损评估方法。现有基于监督学习和特定任务微调的方法在领域迁移、长尾数据分布及异构地理空间数据下泛化能力差,且难以融合多模态信息(如卫星图与街景图)。本文提出RAPID,一个可复现的多智能体管道,实现灾损等级评估、损伤类型解释及应对建议。该系统通过专用智能体完成跨视图理解、图像修复、结构化损伤识别与地理推理,不依赖任务微调,联合利用遥感与地面视角互补信息,实现零样本灾损评估。系统输出细粒度、可解释的评估结果,并自动生成位置相关的决策支持报告,助力早期应急响应。我们在飓风、洪水、山火和地震场景中,使用灾前灾后街景图、灾后遥感图及街景对进行评估。实验表明,RAPID在多灾种分类上总体准确率达0.92,在跨视图损伤严重度预测中最高达0.627,展现了其作为自主灾害智能基础框架的潜力。

原文摘要 · Abstract (English)

Due to the increasing frequency and intensity of extreme climate events, there is a clear demand for intelligent, scalable, and autonomous approaches to disaster damage assessment. Existing methods, largely based on supervised learning and task-specific fine-tuning, struggle to generalize under domain shifts, long-tailed data distributions, and heterogeneous geospatial data sources, especially in disaster scenarios. They also often lack the ability to integrate and reason across multimodal geospatial information, such as satellite images and street-view images. In this paper, we introduce RAPID, a reproducible multi-agent pipeline for interpretable disaster damage assessment, including damage-level assessment, damage-type interpretation, and actionable suggestions for response, remediation, and recovery. RAPID coordinates specialized agents to perform cross-view understanding, image restoration, structured damage recognition, and geographical reasoning across heterogeneous data modalities. Without task-specific fine-tuning, RAPID supports zero-shot damage assessment by jointly using complementary information from remote sensing and ground-level perspectives. The system produces fine-grained, interpretable assessments and automatically generates location-specific, decision-relevant disaster reports to support early-stage emergency response. We evaluate RAPID across hurricanes, floods, wildfires, and earthquakes using multiple cross-view imagery inputs, including pre- and post-disaster street-view images, post-disaster remote sensing imagery, and street-view image pairs. Experiments show that RAPID achieves 0.92 overall accuracy for multi-disaster type classification and up to 0.627 for cross-view damage severity prediction, highlighting its potential as a foundational framework for autonomous disaster intelligence.

灾损评估多模态智能体可解释

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。