用伪标签自动修复COCO数据集标注错误,提升检测模型性能
Pseudo-Labeling Driven Refinement of Benchmark Object Detection Datasets via Analysis of Learning Patterns
- 基于损失与梯度分析定位难样本,通过四阶段伪标签流程修正错误
- 训练模型在多个数据集上精度提升,小物体标注数量增加超20万
- 无需人工重标注,适合想提升检测性能的研究者和工程师
基准目标检测数据集在自动驾驶、监控等计算机视觉应用中至关重要,其中MS-COCO因类别多样、场景复杂成为标准。但其存在漏标、错标、框不准确、重复标注及群体标注不一致等问题,影响模型训练与泛化。本文提出完整修正框架,发布新版本MJ-COCO。首先通过损失与梯度分析识别潜在误标或难学习样本;随后采用四阶段伪标签修正流程:(1)使用可逆变换生成边界框,(2)基于IoU去重并融合置信度,(3)通过专家级识别器验证类别一致性,(4)基于物体区域激活图进行空间调整。该流程实现无监督规模化精准纠错。在MS-COCO、Sama COCO、Objects365和PASCAL VOC四个验证集上实验显示,基于MJ-COCO训练的模型在平均精度(AP)与小物体精度(APS)上持续优于原版。此外,小物体标注数相较原版增加超过20万。
原文摘要 · Abstract (English)
Benchmark object detection (OD) datasets play a pivotal role in advancing computer vision applications such as autonomous driving, and surveillance, as well as in training and evaluating deep learning-based state-of-the-art detection models. Among them, MS-COCO has become a standard benchmark due to its diverse object categories and complex scenes. However, despite its wide adoption, MS-COCO suffers from various annotation issues, including missing labels, incorrect class assignments, inaccurate bounding boxes, duplicate labels, and group labeling inconsistencies. These errors not only hinder model training but also degrade the reliability and generalization of OD models. To address these challenges, we propose a comprehensive refinement framework and present MJ-COCO, a newly re-annotated version of MS-COCO. Our approach begins with loss and gradient-based error detection to identify potentially mislabeled or hard-to-learn samples. Next, we apply a four-stage pseudo-labeling refinement process: (1) bounding box generation using invertible transformations, (2) IoU-based duplicate removal and confidence merging, (3) class consistency verification via expert objects recognizer, and (4) spatial adjustment based on object region activation map analysis. This integrated pipeline enables scalable and accurate correction of annotation errors without manual re-labeling. Extensive experiments were conducted across four validation datasets: MS-COCO, Sama COCO, Objects365, and PASCAL VOC. Models trained on MJ-COCO consistently outperformed those trained on MS-COCO, achieving improvements in Average Precision (AP) and APS metrics. MJ-COCO also demonstrated significant gains in annotation coverage: for example, the number of small object annotations increased by more than 200,000 compared to MS-COCO.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。