arXiv:2601.13895cs.CVcs.AI2026-01被引 6

用SAM 3实现无需训练的开放词汇变化检测,精度领先

OmniOVCD: Streamlining Open-Vocabulary Change Detection with SAM 3

  • 基于SAM 3的解耦输出头设计,融合语义、实例与存在信息生成掩码
  • 在四个基准上达到67.2~27.1的平均交并比,性能最优
  • 无需额外模型,适合遥感变化检测领域研究者使用

变化检测(CD)是遥感中的基础任务,用于监测地表覆盖随时间的演变。开放词汇变化检测(OVCD)旨在减少对预定义类别的依赖。现有无训练方法多采用CLIP识别类别,还需DINO等模型提取特征,不同模型间特征匹配困难导致系统不稳定。近期发布的分割任意模型3(SAM 3)将分割与识别集成于单一可提示模型中,为OVCD带来新可能。本文提出OmniOVCD,一种独立的OVCD框架。通过利用SAM 3的解耦输出头,提出协同融合与实例解耦(SFID)策略:先融合语义、实例与存在输出构建地表覆盖掩码,再分解为独立实例掩码进行变化对比。该设计保持类别识别高精度,并维持图像间实例一致性,从而生成精准变化掩码。在四个公开数据集(LEVIR-CD、WHU-CD、S2Looking、SECOND)上的实验表明,该方法达到67.2、66.5、24.5和27.1的平均交并比,显著优于已有方法。代码已开源。

原文摘要 · Abstract (English)

Change Detection (CD) is a fundamental task in remote sensing. It monitors the evolution of land cover over time. Based on this, Open-Vocabulary Change Detection (OVCD) introduces a new requirement. It aims to reduce the reliance on predefined categories. Existing training-free OVCD methods mostly use CLIP to identify categories. These methods also need extra models like DINO to extract features. However, combining different models often causes problems in matching features and makes the system unstable. Recently, the Segment Anything Model 3 (SAM 3) is introduced. It integrates segmentation and identification capabilities within one promptable model, which offers new possibilities for the OVCD task. In this paper, we propose OmniOVCD, a standalone framework designed for OVCD. By leveraging the decoupled output heads of SAM 3, we propose a Synergistic Fusion to Instance Decoupling (SFID) strategy. SFID first fuses the semantic, instance, and presence outputs of SAM 3 to construct land-cover masks, and then decomposes them into individual instance masks for change comparison. This design preserves high accuracy in category recognition and maintains instance-level consistency across images. As a result, the model can generate accurate change masks. Experiments on four public benchmarks (LEVIR-CD, WHU-CD, S2Looking, and SECOND) demonstrate SOTA performance, achieving IoU scores of 67.2, 66.5, 24.5, and 27.1 (class-average), respectively, surpassing all previous methods. The code is available at https://github.com/Erxucomeon/OmniOVCD.

变化检测SAM 3开放词汇遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。