arXiv:2606.23069cs.CV2026-06中稿 · ECCV被引 1

解决少样本目标检测中类别混淆和定位不准的问题。

Rethinking Prototype-based Similarity Learning for Few-Shot Object Detection

论文配图:Rethinking Prototype-based Similarity Learning for Few-Shot Object Detection
图 1 · 摘自论文原文
  • 用文本特征锚定视觉通道,增强类别间差异
  • 分阶段自回归回归实现逐步精炼边界框,提升定位精度
  • 适用于需要快速适应新类别的目标检测场景

少样本目标检测旨在仅用少量标注样本识别新类别,避免大规模人工标注。现有基于原型的相似性学习方法虽可实现无需训练的适配,但存在两大根本缺陷:(i) 类别间相似性边界坍缩导致类别混淆;(ii) 相似性分数仅反映语义匹配,缺乏空间信息,难以精准定位。为此,本文提出两个互补组件:文本锚定语义掩码(TSMa)利用类别级文本特征作为语义锚点,通过视觉与文本特征的通道级交互,识别语义一致通道,抑制风格引起的虚假响应,强化类别内在信号,扩大类别间相似性边界,缓解混淆问题。进一步提出分阶段对齐层级自回归回归(SHARe),将定位重构为多阶段层级自回归过程,逐级细化边界框。该方法利用ViT特征的层次特性,深层特征引导初期粗略定位,浅层特征富含边缘与纹理信息,用于后期细节优化。在COCO数据集上实验表明,达到新最佳性能,相比之前最优结果提升+10.1 nAP,大量分析验证了各组件有效性。代码已开源。

原文摘要 · Abstract (English)

Few-shot object detection aims to detect novel object categories from only a few labeled examples, avoiding costly large-scale annotation. Recent prototype-based similarity learning approaches enable training-free adaptation by matching query features with class prototypes. However, they suffer from two fundamental limitations: (i) class confusion arising from inter-class similarity margin collapse, and (ii) insufficient visual cues for precise localization, as similarity scores capture only class-level semantic affinity while providing limited spatial information. To address these issues, we introduce two complementary components. Text-Anchored Semantic Mask (TSMa) leverages class-level text features as semantic anchors to identify semantically aligned channels through channel-wise interaction between visual and text features. By suppressing style-induced spurious responses and emphasizing class-intrinsic signals, TSMa enlarges inter-class similarity margins and mitigates class confusion. We further propose Stage-Aligned Hierarchical Autoregressive Regression (SHARe), which reformulates localization as a hierarchical autoregressive process that progressively refines bounding boxes across multiple stages. SHARe leverages the layer-wise characteristics of ViT representations by aligning feature abstraction levels with regression stages: deeper layers guide early coarse localization, while shallower layers rich in edge and texture cues refine spatial details in later stages. Experiments on COCO demonstrate a new state of the art, outperforming the previous best by +10.1 nAP, with extensive analysis validating each component. The code is available at https://github.com/VisualScienceLab-KHU/ReSet.

少样本检测原型学习目标定位视觉语言对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。