arXiv:2506.22161cs.CV2025-06

解耦特征空间中的物体性与分类信息,提升少样本目标检测性能

Attention-disentangled Uniform Orthogonal Feature Space Optimization for Few-shot Object Detection

  • 将特征空间分解为幅度(物体性)和角度(分类)两个正交分量
  • 在COCO数据集上达到62.1%的mAP,显著优于现有方法
  • 适合需要高泛化能力的少样本检测场景

少样本目标检测(FSOD)旨在用少量样本检测新类别对象,同时依赖大量基础类数据。现有方法多基于Faster R-CNN,将物体性识别与前景分类混杂在同一特征空间中,导致类别相关的物体性判断标准,并受新类别样本代表性不足影响。为此,我们提出统一正交特征空间(UOFS)优化框架:首先将特征空间解耦为幅度(编码物体性)与角度(编码分类)两个正交成分,实现从基础类向新类别的类无关物体性知识迁移。为解决两个挑战——(1)基础图像中存在未标注前景实例,混淆潜在新类别实例与背景;(2)角度优化仅依赖基础类前景实例,导致角度分布过拟合于基础类——我们提出混合背景优化(HBO)策略:(1)通过移除原图中未标注实例构建纯背景基础集,提供无偏的幅度物体性监督;(2)将原基础集中未标注前景实例纳入角度优化,增强分布均匀性。此外,提出空间注意力解耦与关联(SADA)模块,缓解类无关与类特定任务间的冲突。实验表明,该方法显著优于基于纠缠特征空间的现有方法。

原文摘要 · Abstract (English)

Few-shot object detection (FSOD) aims to detect objects with limited samples for novel classes, while relying on abundant data for base classes. Existing FSOD approaches, predominantly built on the Faster R-CNN detector, entangle objectness recognition and foreground classification within shared feature spaces. This paradigm inherently establishes class-specific objectness criteria and suffers from unrepresentative novel class samples. To resolve this limitation, we propose a Uniform Orthogonal Feature Space (UOFS) optimization framework. First, UOFS decouples the feature space into two orthogonal components, where magnitude encodes objectness and angle encodes classification. This decoupling enables transferring class-agnostic objectness knowledge from base classes to novel classes. Moreover, implementing the disentanglement requires careful attention to two challenges: (1) Base set images contain unlabeled foreground instances, causing confusion between potential novel class instances and backgrounds. (2) Angular optimization depends exclusively on base class foreground instances, inducing overfitting of angular distributions to base classes. To address these challenges, we propose a Hybrid Background Optimization (HBO) strategy: (1) Constructing a pure background base set by removing unlabeled instances in original images to provide unbiased magnitude-based objectness supervision. (2) Incorporating unlabeled foreground instances in the original base set into angular optimization to enhance distribution uniformity. Additionally, we propose a Spatial-wise Attention Disentanglement and Association (SADA) module to address task conflicts between class-agnostic and class-specific tasks. Experiments demonstrate that our method significantly outperforms existing approaches based on entangled feature spaces.

少样本检测特征解耦正交空间目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。