用视觉大模型先验提升遥感变化检测精度,有效区分真实变化与伪变化。
SemDINO: Foundation Prior-Guided Cross-Temporal Semantic Alignment Network for Remote Sensing Change Detection

- 融合大模型语义先验与卷积特征,自适应对齐跨时相信息。
- 在5个基准数据集上均超越现有方法,显著降低光照、季节等干扰影响。
- 适合遥感图像分析、环境监测等领域的研究人员参考。
遥感语义变化检测(SCD)旨在识别双时相观测间的地表覆盖变化,同时抑制由光照差异、季节变化和配准误差引起的伪变化。尽管视觉基础模型(VFMs)提供可迁移的语义先验,但其在SCD中的应用仍面临模型表示与任务特定空间特征不匹配、时间顺序敏感等问题。为此,本文提出SemDINO,一种基于基础模型先验的框架,将可迁移的视觉基础模型先验与分层卷积表示结合,实现跨时相语义推理。具体地,设计了门控金字塔融合(PyFu)模块,自适应融合基础模型语义与CNN空间细节,减少领域噪声;引入多尺度双向时序变压器(M-TBTT),实现对称的跨时相特征交互,缓解时间顺序偏差;进一步设计特征变化增强(FeaCE)流程,精炼对齐表示,区分真实语义变化与伪变异性。最后,采用多分支解耦预测头联合生成变化掩码、双时相语义图和边缘约束。在五个基准数据集上的大量实验表明,SemDINO在语义与二值化变化检测任务中均持续优于现有先进方法,验证了面向对齐的表征学习在鲁棒遥感变化分析中的有效性。
原文摘要 · Abstract (English)
Semantic change detection (SCD) in remote sensing aims to identify land-cover transitions between bi-temporal observations while suppressing pseudo-changes caused by illumination variations, seasonal differences, and registration errors. Although Vision Foundation Models (VFMs) provide transferable semantic priors, their application to SCD remains challenging due to the mismatch between foundation-model representations and task-specific spatial features, as well as temporal-order sensitivity. To address these issues, this paper proposes SemDINO, a foundation prior-guided framework that integrates transferable vision foundation model priors with hierarchical convolutional representations for cross-temporal semantic reasoning. Specifically, a Gated Pyramid Fusion (PyFu) module is developed to adaptively combine foundation-model semantics with CNN spatial details while reducing domain noise. A Multi-scale Temporal Bi-directional Transformer (M-TBTT) is introduced to achieve symmetric cross-temporal feature interaction and alleviate temporal-order bias. Furthermore, a Feature Change Enhancement (FeaCE) flow is designed to refine aligned representations and distinguish genuine semantic transitions from pseudo variations. Finally, a multi-branch decoupled prediction head jointly generates change masks, bi-temporal semantic maps, and edge constraints. Extensive experiments across five benchmark datasets demonstrate that SemDINO consistently outperforms state-of-the-art methods on both semantic and binary change detection tasks. The results validate the effectiveness of alignment-oriented representation learning for robust remote sensing change analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。