用大模型检测战区损毁,小变化也能精准识别。
Changes in Gaza: DINOv3-Powered Multi-Class Change Detection for Damage Assessment in Conflict Zones
- 基于DINOv3和多尺度注意力,捕捉微小语义变化
- 在三个数据集上实现最高精度,尤其擅长小范围损毁
- 适合人道救援与冲突地区快速评估场景
准确快速评估冲突造成的损毁对人道援助和区域稳定至关重要。在冲突区,损毁区域常具相似建筑风格,损毁面积小且边界模糊,导致数据有限、标注困难,识别面临类内相似度高、语义变化模糊等挑战。为此,本文引入预训练的DINOv3模型,提出多尺度交叉注意力差异孪生网络(MC-DiSNet)。DINOv3骨干网络可从双时相遥感图像中提取鲁棒丰富的特征;多尺度交叉注意力机制实现细微语义变化的精确定位;差异孪生结构增强类别间特征区分力,支持细粒度语义变化检测;同时设计轻量级解码器,在保持高效的同时生成清晰检测图。我们还发布了新的Gaza-Change数据集,包含2023–2024年高分辨率卫星图像对,带有像素级语义变化标注,仅标注变化区域的语义像素。在Gaza-Change、SECOND和Landsat-SCD三个数据集上的实验表明,该方法有效解决了多类变化检测任务,性能优异,为冲突区快速损毁评估提供了实用解决方案。
原文摘要 · Abstract (English)
Accurately and swiftly assessing damage from conflicts is crucial for humanitarian aid and regional stability. In conflict zones, damaged zones often share similar architectural styles, with damage typically covering small areas and exhibiting blurred boundaries. These characteristics lead to limited data, annotation difficulties, and significant recognition challenges, including high intra-class similarity and ambiguous semantic changes. To address these issues, we introduce a pre-trained DINOv3 model and propose a multi-scale cross-attention difference siamese network (MC-DiSNet). The powerful visual representation capability of the DINOv3 backbone enables robust and rich feature extraction from bi-temporal remote sensing images. The multi-scale cross-attention mechanism allows for precise localization of subtle semantic changes, while the difference siamese structure enhances inter-class feature discrimination, enabling fine-grained semantic change detection. Furthermore, a simple yet powerful lightweight decoder is designed to generate clear detection maps while maintaining high efficiency. We also release a new Gaza-change dataset containing high-resolution satellite image pairs from 2023-2024 with pixel-level semantic change annotations. It is worth emphasizing that our annotations only include semantic pixels of changed areas. We evaluated our method on the Gaza-Change and two classical datasets: the SECOND and Landsat-SCD datasets. Experimental results demonstrate that our proposed approach effectively addresses the MCD task, and its outstanding performance paves the way for practical applications in rapid damage assessment across conflict zones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。