提出S2C框架,通过对比学习捕捉遥感图像变化差异,无需标注即可精准检测变化。
S2C: Learning Noise-Resistant Differences for Unsupervised Change Detection in Multimodal Remote Sensing Images
- 设计新型三元组学习策略,显式建模时序差异而非相似性
- 在四个数据集上提升超31%准确率,对噪声和小样本有强鲁棒性
- 适合各类视觉基础模型,代码开源便于复现
多模态遥感图像中的无监督变化检测仍面临时空复杂性与传感器异质性的挑战。受视觉基础模型(VFMs)和对比学习(CL)启发,本文提出一种语义到变化(S2C)学习框架,将视觉基础模型中的隐含知识转化为变化表征,无需显式标注。不同于以往侧重时序相似性的方法,S2C引入新颖的三元组学习策略,显式建模时间差异,这对变化检测至关重要。训练中加入随机空间与光谱扰动以增强对时序噪声的鲁棒性,并引入网格稀疏正则化抑制不显著变化,同时设计交并比匹配算法优化检测结果。在四个基准数据集上的实验表明,S2C框架分别超越当前最优方法31%、9%、23%和15%的准确率,具备优异的鲁棒性与样本效率,适用于多种视觉基础模型或主干网络的训练与适配。代码已公开于github.com/DingLei14/S2C。
原文摘要 · Abstract (English)
Unsupervised Change Detection (UCD) in multimodal Remote Sensing (RS) images remains a difficult challenge due to the inherent spatio-temporal complexity within data, and the heterogeneity arising from different imaging sensors. Inspired by recent advancements in Visual Foundation Models (VFMs) and Contrastive Learning (CL) methodologies, this research aims to develop CL methodologies to translate implicit knowledge in VFM into change representations, thus eliminating the need for explicit supervision. To this end, we introduce a Semantic-to-Change (S2C) learning framework for UCD in both homogeneous and multimodal RS images. Differently from existing CL methodologies that typically focus on learning multi-temporal similarities, we introduce a novel triplet learning strategy that explicitly models temporal differences, which are crucial to the CD task. Furthermore, random spatial and spectral perturbations are introduced during the training to enhance robustness to temporal noise. In addition, a grid sparsity regularization is defined to suppress insignificant changes, and an IoU-matching algorithm is developed to refine the CD results. Experiments on four benchmark CD datasets demonstrate that the proposed S2C learning framework achieves significant improvements in accuracy, surpassing current state-of-the-art by over 31\%, 9\%, 23\%, and 15\%, respectively. It also demonstrates robustness and sample efficiency, suitable for training and adaptation of various Visual Foundation Models (VFMs) or backbone neural networks. The relevant code will be available at: github.com/DingLei14/S2C.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。