用自然语言精准定位遥感图像中的特定变化类型。
Referring Change Detection in Remote Sensing Imagery
- 通过语言提示实现针对特定变化类型的检测,灵活适应用户需求。
- 在多个数据集上实现可扩展的目标化变化检测,准确率显著提升。
- 创新性提出生成式数据合成方法,解决标注数据少与类别不平衡问题。
遥感图像中的变化检测对城市规划、环境监测和灾害管理至关重要。传统方法通常识别所有变化而无法区分类型,难以满足具体需求。虽有语义变化检测尝试分类,但依赖固定类别与模型结构,难以跨数据集复用。为此,本文提出指代式变化检测(RCD),利用自然语言提示精准定位特定变化类型。由于标注数据稀缺且类别严重失衡,我们设计两阶段框架:(I) RCDNet——用于指代变化检测的跨模态融合网络;(II) RCDGen——基于扩散模型的合成数据生成管道,仅需前时相图像即可生成指定类别的后时相图像和变化图,无需语义分割掩码,极大降低数据构建门槛。多数据集实验表明,该框架实现了可扩展、目标导向的变化检测。项目主页:https://yilmazkorkmaz1.github.io/RCD。
原文摘要 · Abstract (English)
Change detection in remote sensing imagery is essential for applications such as urban planning, environmental monitoring, and disaster management. Traditional change detection methods typically identify all changes between two temporal images without distinguishing the types of transitions, which can lead to results that may not align with specific user needs. Although semantic change detection methods have attempted to address this by categorizing changes into predefined classes, these methods rely on rigid class definitions and fixed model architectures, making it difficult to mix datasets with different label sets or reuse models across tasks, as the output channels are tightly coupled with the number and type of semantic classes. To overcome these limitations, we introduce Referring Change Detection (RCD), which leverages natural language prompts to detect specific classes of changes in remote sensing images. By integrating language understanding with visual analysis, our approach allows users to specify the exact type of change they are interested in. However, training models for RCD is challenging due to the limited availability of annotated data and severe class imbalance in existing datasets. To address this, we propose a two-stage framework consisting of (I) \textbf{RCDNet}, a cross-modal fusion network designed for referring change detection, and (II) \textbf{RCDGen}, a diffusion-based synthetic data generation pipeline that produces realistic post-change images and change maps for a specified category using only pre-change image, without relying on semantic segmentation masks and thereby significantly lowering the barrier to scalable data creation. Experiments across multiple datasets show that our framework enables scalable and targeted change detection. Project website is here: https://yilmazkorkmaz1.github.io/RCD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。