用基础模型提升遥感影像语义变化检测精度与稳定性。
Foundation Model-Driven Semantic Change Detection in Remote Sensing Imagery
- 设计级联门控解码器,适配多种骨干网络,自适应提取多尺度变化特征。
- 在SECOND和LandsatSCD数据集上分别达26.11%和65.21%的Sek得分,刷新纪录。
- 支持少样本训练、跨模型泛化,适合遥感变化监测实际应用。
遥感变化检测对理解地表动态至关重要。语义变化检测(SCD)可实现像素级多类别变化分析,但易受成像条件引起的伪变化干扰。近期遥感基础模型能提取跨时序与环境变化的语义一致特征,有助于缓解伪变化问题。然而现有SCD方法通常结构僵化且依赖特定主干网络,难以融合新兴基础模型的多尺度特征。为此,本文提出模块化级联门控解码器(CG-Decoder),可适配不同主干网络,以由粗到细方式处理多尺度特征并实现自适应变化提取。基于遥感基础模型PerA,构建统一的SCD框架PerASCD。进一步提出软语义一致性损失(SSCLoss),缓解混合精度训练中的数值不稳定性。在SECOND和LandsatSCD数据集上的大量实验表明,PerASCD取得新最优结果,Sek得分分别为26.11%和65.21%,较前人最佳分别提升0.61%和4.95%。其还展现优异数据效率(仅需50%数据即超越全量数据基线)、无缝跨主干泛化能力与更强可解释性。该方法在辐射变化下仍保持稳健语义一致性,提供可靠变化检测方案。
原文摘要 · Abstract (English)
Remote sensing (RS) change detection is essential for interpreting surface dynamics. Semantic change detection (SCD) further enables pixel-level understanding of multi-class transitions, yet remains sensitive to pseudo-changes induced by imaging conditions. Recent RS foundation models extract semantically consistent features across temporal and environmental variations, which is critical for mitigating pseudo-changes. However, existing SCD methods are often rigid and backbone-specific, lacking the flexibility to integrate diverse multi-scale features from emerging foundation models. To this end, we introduce a modular Cascaded Gated Decoder (CG-Decoder) that bridges various backbones and SCD tasks, processing multi-scale features in a coarse-to-fine manner while enabling adaptive change extraction. Building upon the RS foundation model PerA, we present PerASCD, a unified SCD framework. We further propose a Soft Semantic Consistency Loss (SSCLoss) to mitigate numerical instability in mixed-precision training. Extensive experiments on SECOND and LandsatSCD show that PerASCD achieves new state-of-the-art Sek scores (26.11% and 65.21%), surpassing the previous best by 0.61% and 4.95%, respectively. It also demonstrates exceptional data efficiency (outperforming the full-data baseline with 50% data), seamless cross-backbone generalization, and enhanced interpretability. Our approach maintains robust semantic consistency under radiometric variations, providing a reliable SCD solution. Code: https://github.com/SathShen/PerASCD.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。