通过类别级协作知识挖掘,提升跨域新类别检测的适应能力。
Towards Adaptive Open-Set Object Detection via Category-Level Collaboration Knowledge Mining
- 构建聚类记忆库,融合类间类内关系,增强类别知识表征。
- 在多个基准上实现1.1-5.5 mAP提升,显著优于现有方法。
- 适合需要零样本迁移和开放集检测的研究者使用。
现有目标检测器在跨域泛化和新增类别适应方面表现不佳。自适应开放集目标检测(AOOD)通过在源域基类别上训练,并在无目标域标注的情况下适应源域和新类别,应对这一挑战。然而,当前方法受限于弱跨域表征、新类别歧义以及源域特征偏差。为此,本文提出一种类别级协作知识挖掘策略,利用跨域的类间与类内关系。具体地,构建基于聚类的记忆库以编码类别原型、辅助特征及类内差异信息,并通过无监督聚类迭代更新,强化类别级知识表示。进一步设计基到新类的选择度量,识别与新类别相关的源域特征,并用于初始化新类别分类器。此外,采用自适应特征分配策略将学习到的类别级知识迁移到目标域,并异步更新记忆库以缓解源域偏差。在多个基准上的大量实验表明,该方法持续超越现有最优的AOOD方法,提升1.1至5.5 mAP。
原文摘要 · Abstract (English)
Existing object detectors often struggle to generalize across domains while adapting to emerging novel categories. Adaptive open-set object detection (AOOD) addresses this challenge by training on base categories in the source domain and adapting to both base and novel categories in the target domain without target annotations. However, current AOOD methods remain limited by weak cross-domain representations, ambiguity among novel categories, and source-domain feature bias. To address these issues, we propose a category-level collaboration knowledge mining strategy that exploits both inter-class and intra-class relationships across domains. Specifically, we construct a clustering-based memory bank to encode class prototypes, auxiliary features, and intra-class disparity information, and iteratively update it via unsupervised clustering to enhance category-level knowledge representation. We further design a base-to-novel selection metric to discover source-domain features related to novel categories and use them to initialize novel-category classifiers. In addition, an adaptive feature assignment strategy transfers the learned category-level knowledge to the target domain and asynchronously updates the memory bank to alleviate source-domain bias. Extensive experiments on multiple benchmarks show that our method consistently surpasses state-of-the-art AOOD methods by 1.1-5.5 mAP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。