通过上下文一致性学习提升开放词汇目标检测在不同场景下的鲁棒性
Consistency Beyond Contrast: Enhancing Open-Vocabulary Object Detection Robustness via Contextual Consistency Learning
- 设计上下文自举数据生成与一致性损失,增强模型对同一物体在不同环境中的识别稳定性
- 在OmniLabel和D3数据集上分别提升16.3和14.9的AP,显著优于现有方法
- 适合关注模型泛化能力与真实场景适应性的研究者和开发者
近期开放词汇目标检测研究主要聚焦于数据集扩展和对比学习以对齐语言与视觉模态。然而,这些方法常忽视单一模态内部的一致性,尤其在背景或环境变化时,导致模型难以在不同场景中稳定检测同一物体,暴露出鲁棒性缺陷。为此,我们提出上下文一致性学习(CCL)框架,包含两个关键策略:上下文自举数据生成(CBDG)与上下文一致性损失(CCLoss)。CBDG作为数据生成机制,生成包含相同物体但背景多样的图像,弥补现有数据集不足;CCLoss则强制物体特征在环境变化下保持不变,提升模型鲁棒性。该框架统一实现了模态内一致性。实验显示,本方法在OmniLabel和D3数据集上分别达到+16.3 AP和+14.9 AP的性能提升,验证了强化模态内一致性的必要性,显著增强了模型在多样化环境中的泛化能力。代码已公开于https://github.com/bozhao-li/CCL。
原文摘要 · Abstract (English)
Recent advances in open-vocabulary object detection focus primarily on two aspects: scaling up datasets and leveraging contrastive learning to align language and vision modalities. However, these approaches often neglect internal consistency within a single modality, particularly when background or environmental changes occur. This lack of consistency leads to a performance drop because the model struggles to detect the same object in different scenes, which reveals a robustness gap. To address this issue, we introduce Contextual Consistency Learning (CCL), a novel framework that integrates two key strategies: Contextual Bootstrapped Data Generation (CBDG) and Contextual Consistency Loss (CCLoss). CBDG functions as a data generation mechanism, producing images that contain the same objects across diverse backgrounds. This is essential because existing datasets alone do not support our CCL framework. The CCLoss further enforces the invariance of object features despite environmental changes, thereby improving the model's robustness in different scenes. These strategies collectively form a unified framework for ensuring contextual consistency within the same modality. Our method achieves state-of-the-art performance, surpassing previous approaches by +16.3 AP on OmniLabel and +14.9 AP on D3. These results demonstrate the importance of enforcing intra-modal consistency, significantly enhancing model generalization in diverse environments. Our code is publicly available at: https://github.com/bozhao-li/CCL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。