arXiv:2603.27645cs.CV2026-03中稿 · CVPR被引 2

用扩散模型生成类别原型,实现遥感图像任意变化检测的高精度识别。

OpenDPR: Open-Vocabulary Change Detection via Vision-Centric Diffusion-Guided Prototype Retrieval for Remote Sensing Imagery

  • 基于视觉-语言模型与扩散模型,构建可扩展的类别原型库。
  • 在四个数据集上达到当前最佳性能,弱监督版本仅需少量标注。
  • 适合遥感变化检测、开放词汇识别等任务的研究者使用。

开放词汇变化检测(OVCD)旨在识别任意感兴趣的改变,突破预定义类别的限制。本文将OVCD重构为两阶段流程:先利用视觉基础模型(如SAM、DINOv2)生成无类别变化提案,再通过视觉-语言模型(如CLIP)进行类别识别。研究发现,类别识别错误是主要瓶颈,源于基于图文匹配的VLM对细粒度地表覆盖类别的表征能力有限。为此,提出OpenDPR——一种无需训练的视觉中心扩散引导原型检索框架。该框架离线利用扩散模型构建目标类别的多样化原型,并在推理时于视觉空间中与变化提案进行相似性检索。另一个瓶颈在于变化定位,因视觉基础模型缺乏变化先验。为此设计了名为S2C的空间到变化弱监督变化检测模块,充分利用其强大的空间建模能力。将预训练的S2C集成至OpenDPR,得到可选的弱监督变体OpenDPR-W,进一步提升性能且只需极少标注。在四个基准数据集上的实验表明,所提方法在两种监督模式下均达到当前最优效果。代码已开源。

原文摘要 · Abstract (English)

Open-vocabulary change detection (OVCD) seeks to recognize arbitrary changes of interest by enabling generalization beyond a fixed set of predefined classes. We reformulate OVCD as a two-stage pipeline: first generate class-agnostic change proposals using visual foundation models (VFMs) such as SAM and DINOv2, and then perform category identification with vision-language models (VLMs) such as CLIP. We reveal that category identification errors are the primary bottleneck of OVCD, mainly due to the limited ability of VLMs based on image-text matching to represent fine-grained land-cover categories. To address this, we propose OpenDPR, a training-free vision-centric diffusion-guided prototype retrieval framework. OpenDPR leverages diffusion models to construct diverse prototypes for target categories offline, and to perform similarity retrieval with change proposals in the visual space during inference. The secondary bottleneck lies in change localization, due to the inherent lack of change priors in VFMs. To bridge this gap, we design a spatial-to-change weakly supervised change detection module named S2C to adapt their strong spatial modeling capabilities for change localization. Integrating the pretrained S2C into OpenDPR leads to an optional weakly supervised variant named OpenDPR-W, which further improves OVCD with minimal supervision. Experimental results on four benchmark datasets demonstrate that the proposed methods achieve state-of-the-art performance under both supervision modes. Code is available at https://github.com/guoqi2002/OpenDPR.

变化检测扩散模型开放词汇遥感图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。