arXiv:2604.22333cs.CVcs.AI2026-04

用多模态模型实现灾后场景的交互式语义分析,支持复杂查询。

ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding

论文配图:ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding
图 1 · 摘自论文原文
  • 构建融合光学与雷达数据的灾害变化查询数据集
  • 自动标注生成带空间位置和数量信息的指令集
  • 可回答用户关于损毁区域、量化评估等复杂问题

灾后快速态势感知对应急响应至关重要。尽管遥感损毁评估正从像素级变化检测向高层次语义分析演进,现有视觉-语言方法仍难以提供针对复杂战略问题的可操作情报。主要受限于单一光学模态依赖、对自然灾害的偏见,以及缺乏真实交互能力。为此,我们提出 ChangeQuery,一个统一的多模态框架,用于全天候灾害态势全面感知。为克服模态限制与场景偏差,我们构建了灾害诱发变化查询(DICQ)数据集,该数据集在自然灾难与武装冲突间平衡分布,耦合灾前光学语义与灾后合成孔径雷达(SAR)结构特征。为进一步提供高质量监督信号,我们提出一种新型自动化语义标注流水线。遵循“先统计、后生成”范式,该引擎将原始分割掩码自动转换为具有语义锚定的分层指令集,有效赋予模型细粒度的空间与定量认知能力。基于此结构化数据训练的 ChangeQuery 架构,可作为交互式灾害分析师,支持由多样化用户查询驱动的多任务推理,精准输出损毁量化结果、区域特异性描述及灾后整体总结。大量实验表明,ChangeQuery 达到新基准性能,为复杂灾害监测提供了鲁棒且可解释的解决方案。代码已公开于:https://sundongwei.github.io/changequery/

原文摘要 · Abstract (English)

Rapid situational awareness is critical in post-disaster response. While remote sensing damage assessment is evolving from pixel-level change detection to high-level semantic analysis, existing vision-language methodologies still struggle to provide actionable intelligence for complex strategic queries. They remain severely constrained by unimodal optical dependence, a prevailing bias towards natural disasters, and a fundamental lack of grounded interactivity. To address these limitations, we present ChangeQuery, a unified multimodal framework designed for comprehensive, all-weather disaster situation awareness. To overcome modality constraints and scenario biases, we construct the Disaster-Induced Change Query (DICQ) dataset, a large-scale benchmark coupling pre-event optical semantics with post-event SAR structural features across a balanced distribution of natural catastrophes and armed conflicts. Furthermore, to provide the high-quality supervision required for interactive reasoning, we propose a novel Automated Semantic Annotation Pipeline. Adhering to a ``statistics-first, generation-later'' paradigm, this engine automatically transforms raw segmentation masks into grounded, hierarchical instruction sets, effectively equipping the model with fine-grained spatial and quantitative awareness. Trained on this structured data, the ChangeQuery architecture operates as an interactive disaster analyst. It supports multi-task reasoning driven by diverse user queries, delivering precise damage quantification, region-specific descriptions, and holistic post-disaster summaries. Extensive experiments demonstrate that ChangeQuery establishes a new state-of-the-art, providing a robust and interpretable solution for complex disaster monitoring. The code is available at \href{https://sundongwei.github.io/changequery/}{https://sundongwei.github.io/changequery/}.

遥感分析多模态灾害监测交互式系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。