用轻量微调让大模型精准识别遥感影像变化,抑制伪变化。
PeftCD: Leveraging Vision Foundation Models with Parameter-Efficient Fine-Tuning for Remote Sensing Change Detection
- 基于视觉大模型,用LoRA和适配器仅训练少量参数实现高效适配。
- 在7个公开数据集上表现领先,最高达97.01%的交并比,边界精确。
- 适合需要快速部署、标注少、跨域泛化强的遥感变化检测任务。
针对多时相、多源遥感影像中伪变化普遍、标注样本稀缺及跨域泛化困难的问题,本文提出PeftCD框架,基于视觉基础模型(VFMs)结合参数高效微调(PEFT)。核心采用共享权重的孪生编码器,集成LoRA与适配器模块,仅训练少量新增参数即可实现高效任务适配。研究对比了SAM2(强分割先验)和DINOv3(自监督表征学习)两种先进骨干网络,搭配轻量化解码器,聚焦骨干特征表达。大量实验表明,PeftCD在多个公开数据集上达到领先性能:SYSU-CD(IoU 73.81%)、WHUCD(92.05%)、MSRSCD(64.07%)、MLCD(76.89%)、CDD(97.01%)、S2Looking(52.25%)、LEVIR-CD(85.62%),显著提升边界精度并有效抑制伪变化。整体实现精度、效率与泛化能力的最优平衡,为大规模视觉基础模型在真实遥感变化检测中的应用提供可扩展范式。代码与预训练模型将开源。
原文摘要 · Abstract (English)
To tackle the prevalence of pseudo changes, the scarcity of labeled samples, and the difficulty of cross-domain generalization in multi-temporal and multi-source remote sensing imagery, we propose PeftCD, a change detection framework built upon Vision Foundation Models (VFMs) with Parameter-Efficient Fine-Tuning (PEFT). At its core, PeftCD employs a weight-sharing Siamese encoder derived from a VFM, into which LoRA and Adapter modules are seamlessly integrated. This design enables highly efficient task adaptation by training only a minimal set of additional parameters. To fully unlock the potential of VFMs, we investigate two leading backbones: the Segment Anything Model v2 (SAM2), renowned for its strong segmentation priors, and DINOv3, a state-of-the-art self-supervised representation learner. The framework is complemented by a deliberately lightweight decoder, ensuring the focus remains on the powerful feature representations from the backbones. Extensive experiments demonstrate that PeftCD achieves state-of-the-art performance across multiple public datasets, including SYSU-CD (IoU 73.81%), WHUCD (92.05%), MSRSCD (64.07%), MLCD (76.89%), CDD (97.01%), S2Looking (52.25%) and LEVIR-CD (85.62%), with notably precise boundary delineation and strong suppression of pseudo-changes. In summary, PeftCD presents an optimal balance of accuracy, efficiency, and generalization. It offers a powerful and scalable paradigm for adapting large-scale VFMs to real-world remote sensing change detection applications. The code and pretrained models will be released at https://github.com/dyzy41/PeftCD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。