提升罕见物体检测性能,通过改进分类与特征学习解决类别不平衡问题。
Improving Long-Tailed Object Detection with Balanced Group Softmax and Metric Learning
- 改进平衡分组Softmax,缓解长尾分布下的分类偏差
- 在LVISv1数据集上实现24.5% mAP,优于此前24.0%的基准
- 引入度量学习与k-NN分类,增强稀有类别特征区分度
目标检测在如COCO等类别均衡的数据集上已取得广泛进展,但现实场景中常面临长尾分布问题——大量类别仅含少量样本。这种固有的类别不平衡使检测模型偏向高频类别,导致对稀有类别的性能下降。本文针对LVISv1数据集(含1,203个类别、164,000张图像)中的2D目标检测长尾问题,采用两阶段Faster R-CNN架构,对平衡分组Softmax(BAGS)框架进行优化。所提方法在该数据集上达到24.5%的平均精度(mAP),超越此前24.0%的基准表现。我们进一步假设:尾部类别特征在头部类别特征空间中形成更小、更密集的聚类,使基于回归的分类器难以区分。为此,引入度量学习,生成类间分离度高、类内紧凑的特征嵌入,并在推理时采用k-近邻(k-NN)策略提升稀有类别分类效果。实验验证了这些方法在长尾目标检测中的有效性。
原文摘要 · Abstract (English)
Object detection has been widely explored for class-balanced datasets such as COCO. However, real-world scenarios introduce the challenge of long-tailed distributions, where numerous categories contain only a few instances. This inherent class imbalance biases detection models towards the more frequent classes, degrading performance on rare categories. In this paper, we tackle the problem of long-tailed 2D object detection using the LVISv1 dataset, which consists of 1,203 categories and 164,000 images. We employ a two-stage Faster R-CNN architecture and propose enhancements to the Balanced Group Softmax (BAGS) framework to mitigate class imbalance. Our approach achieves a new state-of-the-art performance with a mean Average Precision (mAP) of 24.5%, surpassing the previous benchmark of 24.0%. Additionally, we hypothesize that tail class features may form smaller, denser clusters within the feature space of head classes, making classification challenging for regression-based classifiers. To address this issue, we explore metric learning to produce feature embeddings that are both well-separated across classes and tightly clustered within each class. For inference, we utilize a k-Nearest Neighbors (k-NN) approach to improve classification performance, particularly for rare classes. Our results demonstrate the effectiveness of these methods in advancing long-tailed object detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。