用分形维数校准稀有目标检测,提升小样本类别识别效果
Fractal Calibration for long-tailed object detection
- 基于图像空间分布的分形维数调整预测概率
- 在LVIS上使稀有类别性能提升最高8.6%
- 无需训练,可兼容主流检测模型,适用多数据集
真实世界数据集存在显著的类别不平衡问题,给稀有类别目标检测带来挑战。现有方法依赖类别频率进行重加权或重采样,但仅关注统计频率,忽略类别在图像空间中的分布特性。为此,我们提出FRActal CALibration(FRACAL):一种针对长尾目标检测的后处理校准方法。FRACAL通过分形维数估计类别在图像空间中的分布均匀性,推理时逆向降低均匀分布类别的预测概率,实现频次与空间分布双平衡。该方法无需训练,可与一阶段Sigmoid检测器、两阶段实例分割模型等集成。在LVIS数据集上,稀有类别性能提升最高达8.6%,优于所有先前方法,并在COCO、V3Det和OpenImages上展现良好泛化能力。代码已开源。
原文摘要 · Abstract (English)
Real-world datasets follow an imbalanced distribution, which poses significant challenges in rare-category object detection. Recent studies tackle this problem by developing re-weighting and re-sampling methods, that utilise the class frequencies of the dataset. However, these techniques focus solely on the frequency statistics and ignore the distribution of the classes in image space, missing important information. In contrast to them, we propose FRActal CALibration (FRACAL): a novel post-calibration method for long-tailed object detection. FRACAL devises a logit adjustment method that utilises the fractal dimension to estimate how uniformly classes are distributed in image space. During inference, it uses the fractal dimension to inversely downweight the probabilities of uniformly spaced class predictions achieving balance in two axes: between frequent and rare categories, and between uniformly spaced and sparsely spaced classes. FRACAL is a post-processing method and it does not require any training, also it can be combined with many off-the-shelf models such as one-stage sigmoid detectors and two-stage instance segmentation models. FRACAL boosts the rare class performance by up to 8.6% and surpasses all previous methods on LVIS dataset, while showing good generalisation to other datasets such as COCO, V3Det and OpenImages. We provide the code at https://github.com/kostas1515/FRACAL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。