用类别间关系指导检测,让模型在少样本下更好识别新类别。
Class Geometry as Supervision for Sample-Efficient Open-World Detection

- 通过保持类别间的视觉/语义差异结构来训练模型原型
- 在少样本医学图像中提升新类别识别能力,未知物体召回率提高
- 适合数据稀缺场景的可扩展目标检测系统
开放世界目标检测要求模型能识别已知类别、拒绝未知对象,并随时间纳入新类别。这在生物医学和科学成像等少样本场景中尤为困难,因罕见类别仅有少量标注样本,细粒度类别间差异微小。基于原型的检测器适用于此类情况,但通常将类别原型视为独立锚点,忽略类别间的关联结构。本文提出类别几何监督(CGS),一种通用框架,约束学习到的原型或类别表示空间以保留从训练数据中估计出的视觉或语义类别差异。CGS引入一个保持差异性的目标函数,使学习到的类别表示之间的成对距离与目标类别几何矩阵对齐,同时保留标准任务损失。我们在原型识别、少样本生物医学物体检测、开集检测、新类别插入及COCO上的开放世界检测适应中应用同一目标。实验表明,CGS在识别和卵细胞检测中提升样本效率,显著增强新类别插入能力,并在COCO上提高未知召回率,同时保持较高已知类别检测性能。消融实验显示,有意义的视觉几何结构带来最可靠增益,随机几何虽有助于新类分离,但在少样本检测中表现不稳定。结果表明,类别关系结构是有限监督下构建校准且可扩展开放世界检测器的有效监督信号。
原文摘要 · Abstract (English)
Open-world object detection requires models to recognize known categories, reject unfamiliar objects, and incorporate new classes over time. This is especially challenging in scarce-data settings such as biomedical and scientific imaging, where rare categories may have only a few annotated examples and fine-grained classes differ by subtle morphology. Prototype-based detectors are natural for this regime, but they typically learn class prototypes as independent anchors, ignoring relational structure among classes. We propose class-geometry supervision (CGS), a general framework that constrains learned prototype or class-representation spaces to preserve visual or semantic class dissimilarities estimated from training data. CGS introduces a dissimilarity-preserving objective that aligns pairwise distances among learned class representations with a target class-geometry matrix while retaining the standard task loss. We instantiate the same objective across prototype recognition, few-shot biomedical object detection, open-set detection, novel-class insertion, and OWOD adaptation on COCO. Experiments show that CGS improves sample efficiency in recognition and ova detection, substantially strengthens novel-class insertion, and improves unknown recall on COCO while retaining much of the known-class detection performance. Ablations show that meaningful visual geometry provides the most reliable gains, while random geometry can help novel separation but is less consistent for few-shot detection. These results suggest that relational class geometry is an effective supervisory signal for building calibrated and extensible open-world detectors under limited supervision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。