arXiv:2605.12282cs.CV2026-05

用大小模型协作提升农田变化检测精度,有效抑制伪变化干扰。

Large-Small Model Collaboration for Farmland Semantic Change Detection

论文配图:Large-Small Model Collaboration for Farmland Semantic Change Detection
图 1 · 摘自论文原文
  • 小模型专注细粒度变化特征,大模型利用文本先验抑制伪变化。
  • 在自建数据集上达97.63% F1,参数仅665万,远低于同类模型。
  • 适合需要高精度、低资源的农田保护与遥感监测场景。

农田语义变化检测对耕地保护至关重要,但现有基准和模型难以实现细粒度监测。当前数据集缺乏明确的“从-到”标注,视觉变化检测模型易受作物轮作、季节变化和光照差异引起的伪变化干扰。为此,我们构建了大规模细粒度农田变化检测基准HZNU-FCD,包含4,588对双时相图像及像素级标签,用于实际耕地保护。基于此,提出大-小模型协同框架:小模型FD-Mamba学习密集变化表征以保留边界和定位小区域;大模型路径采用基于CLIP的跨模态逻辑仲裁(CMLA),引入文本先验实现提示引导的语义仲裁与伪变化抑制。为促进协作,设计硬区域共训练策略,仅在低置信度像素上监督CMLA的语义得分图。实验表明,本方法在HZNU-FCD上取得97.63% F1、96.32% IoU、96.35% SCD_IoU_mean,仅需6.65M可训练参数。相比多模态ChangeCLIP-ViT,F1提升10.19个百分点。在LEVIR-CD和WHU-CD上分别达到91.43% F1、84.21% IoU和93.85% F1、88.41% IoU,展现强鲁棒性与泛化能力。代码已开源。

原文摘要 · Abstract (English)

Farmland Semantic Change Detection (SCD) is essential for cultivated land protection, yet existing benchmarks and models remain insufficient for fine-grained farmland conversion monitoring. Current datasets often lack dedicated "from-to" annotations, while visual change detection models are easily disturbed by phenology-induced pseudo-changes caused by crop rotation, seasonal variation, and illumination differences. To address these challenges, we construct HZNU-FCD, a large-scale fine-grained farmland SCD benchmark with a unified five-class farmland-to-non-farmland annotation protocol. It contains 4,588 bitemporal image pairs with pixel-level labels for practical farmland protection. Based on this benchmark, we propose a large-small collaborative SCD framework that integrates a task-driven small visual model with a frozen large vision-language model. The small model, Fine-grained Difference-aware Mamba (FD-Mamba), learns dense change representations for boundary preservation and small-region localization. The large-model pathway, Cross-modal Logical Arbitration (CMLA), introduces CLIP-based textual priors for prompt-guided semantic arbitration and pseudo-change suppression. To enable effective collaboration, we design a hard-region co-training strategy that supervises the CMLA semantic score map only on low-confidence pixels. Experiments show that our method achieves 97.63% F1, 96.32% IoU, and 96.35% SCD_IoU_mean on HZNU-FCD with only 6.65M trainable parameters. Compared with the multimodal ChangeCLIP-ViT, which leverages vision-language information for change detection, our method improves F1 by 10.19 percentage points on HZNU-FCD. It also achieves 91.43% F1 and 84.21% IoU on LEVIR-CD, and 93.85% F1 and 88.41% IoU on WHU-CD, demonstrating strong robustness and generalization. The code is available at https://github.com/Lovelymili/FD-Mamba.

变化检测遥感小模型大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。