提出新模型解决遥感影像伪变化问题,提升跨域检测泛化能力。
Generalization-aware Remote Sensing Change Detection via Domain-agnostic Learning
- 用局部统计量替代全局风格特征,缓解图像失真问题。
- 在三个公开数据集上优于现有方法,且模型更小、抗域偏移更强。
- 适合需要跨区域部署的遥感变化检测场景。
变化检测对区域发展具有重要意义,其中由成像环境差异引起的双时相影像伪变化是主要挑战。现有基于变换的方法将伪变化视为风格差异,利用生成对抗网络(GAN)对双时相图像进行风格统一以缓解问题。然而存在两个局限:1)变换后的图像易产生失真,降低特征区分度;2)对齐机制阻碍模型学习域无关表示,导致在训练数据域外场景性能下降。为此,我们提出一种泛化感知的域无关差异学习网络(DonaNet)。针对第一点,采用局部统计量作为风格代理,增强对域偏移的鲁棒性;针对第二点,通过去除编码特征中的域特定风格并强化目标类别特征,实现域无关表示学习。具体提出域差异消除模块,在减少特征方差的同时保留判别性;其增强版本通过解耦特征相关性,进一步消除更多风格成分。同时设计跨时相泛化学习策略,模拟潜在域偏移,主动提升模型对域偏移的鲁棒性。在三个公开数据集上的大量实验表明,DonaNet在模型更小的情况下优于现有最先进方法,且对域偏移更具鲁棒性。
原文摘要 · Abstract (English)
Change detection has essential significance for the region's development, in which pseudo-changes between bitemporal images induced by imaging environmental factors are key challenges. Existing transformation-based methods regard pseudo-changes as a kind of style shift and alleviate it by transforming bitemporal images into the same style using generative adversarial networks (GANs). However, their efforts are limited by two drawbacks: 1) Transformed images suffer from distortion that reduces feature discrimination. 2) Alignment hampers the model from learning domain-agnostic representations that degrades performance on scenes with domain shifts from the training data. Therefore, oriented from pseudo-changes caused by style differences, we present a generalizable domain-agnostic difference learning network (DonaNet). For the drawback 1), we argue for local-level statistics as style proxies to assist against domain shifts. For the drawback 2), DonaNet learns domain-agnostic representations by removing domain-specific style of encoded features and highlighting the class characteristics of objects. In the removal, we propose a domain difference removal module to reduce feature variance while preserving discriminative properties and propose its enhanced version to provide possibilities for eliminating more style by decorrelating the correlation between features. In the highlighting, we propose a cross-temporal generalization learning strategy to imitate latent domain shifts, thus enabling the model to extract feature representations more robust to shifts actively. Extensive experiments conducted on three public datasets demonstrate that DonaNet outperforms existing state-of-the-art methods with a smaller model size and is more robust to domain shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。