arXiv:2604.02753cs.CV2026-04中稿 · ICLR被引 4

将语义认知与检测分离,提升开放词汇目标检测效率与精度

DeCo-DETR: Decoupled Cognition DETR for efficient Open-Vocabulary Object Detection

  • 用预训练大模型生成区域描述,构建可复用的分层语义原型空间
  • 解耦训练目标,使定位与语义识别并行优化,兼顾闭集精度与开放泛化
  • 无需推理时编码文本,显著降低计算开销,适合实际部署

开放词汇目标检测(OVOD)使模型能识别未预定义类别的物体,但现有方法在实际部署中仍受限。一方面,多模态设计常因推理时依赖文本编码器导致巨大计算开销;另一方面,紧密耦合的训练目标在闭集检测精度与开放世界泛化间形成权衡。为此,我们提出视觉主导的解耦认知DETR(DeCo-DETR),通过统一的解耦范式解决上述问题。该框架不依赖在线文本编码,而是利用预训练大语言视觉模型(LVLM)生成区域级描述,并通过CLIP对齐构建分层语义原型空间,实现高效可复用的语义表征。在此基础上,通过解耦训练策略,将语义推理与定位任务分离为并行优化流。在标准OVOD基准上的大量实验表明,DeCo-DETR在保持竞争力的零样本检测性能的同时,显著提升推理效率。结果验证了将语义认知与检测解耦的有效性,为可扩展的OVOD系统提供了实用方向。

原文摘要 · Abstract (English)

Open-vocabulary object detection (OVOD) enables models to recognize objects beyond predefined categories, but existing approaches remain limited in practical deployment. On the one hand, multimodal designs often incur substantial computational overhead due to their reliance on text encoders at inference time. On the other hand, tightly coupled training objectives introduce a trade-off between closed-set detection accuracy and open-world generalization. Thus, we propose Decoupled Cognition DETR (DeCo-DETR), a vision-centric framework that addresses these challenges through a unified decoupling paradigm. Instead of depending on online text encoding, DeCo-DETR constructs a hierarchical semantic prototype space from region-level descriptions generated by pre-trained LVLMs and aligned via CLIP, enabling efficient and reusable semantic representation. Building upon this representation, the framework further disentangles semantic reasoning from localization through a decoupled training strategy, which separates alignment and detection into parallel optimization streams. Extensive experiments on standard OVOD benchmarks demonstrate that DeCo-DETR achieves competitive zero-shot detection performance while significantly improving inference efficiency. These results highlight the effectiveness of decoupling semantic cognition from detection, offering a practical direction for scalable OVOD systems.

目标检测开放词汇解耦学习高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。