arXiv:2503.02897cs.CVcs.AI2025-03被引 1

用视觉语言模型自动检测目标检测标注错误,提升标注质量。

ClipGrader: Leveraging Vision-Language Models for Robust Label Quality Assessment in Object Detection

  • 基于CLIP模型评估框位置和类别准确性
  • 在COCO上达91%准确率,仅1.8%误报率
  • 适合大规模数据集质检与半监督训练

高质量标注对目标检测模型至关重要,但确保边界框标注的准确性仍具挑战且成本高昂。本文提出ClipGrader,一种利用视觉语言模型自动评估边界框标注准确性的新方法。通过适配CLIP(对比图像-文本预训练)模型,ClipGrader可同时评估类别正确性与空间精度。在人工扰动边界框的修改版数据集上测试,ClipGrader在COCO数据集上达到91%准确率,误报率仅1.8%;仅用10%的COCO数据训练时,仍保持87%准确率,误报率2.1%。该方法在更大规模的LVIS数据集上表现良好,覆盖1,203个类别,准确率达79%。实验表明,ClipGrader能有效识别现有COCO标注中的错误,具备数据集优化潜力。将其集成至半监督目标检测(SSOD)模型中,可显著提升伪标签质量,全程提高mAP(平均精度均值)。ClipGrader为大规模目标检测数据集的标注质量控制与验证提供了可扩展的AI辅助工具。

原文摘要 · Abstract (English)

High-quality annotations are essential for object detection models, but ensuring label accuracy - especially for bounding boxes - remains both challenging and costly. This paper introduces ClipGrader, a novel approach that leverages vision-language models to automatically assess the accuracy of bounding box annotations. By adapting CLIP (Contrastive Language-Image Pre-training) to evaluate both class label correctness and spatial precision of bounding box, ClipGrader offers an effective solution for grading object detection labels. Tested on modified object detection datasets with artificially disturbed bounding boxes, ClipGrader achieves 91% accuracy on COCO with a 1.8% false positive rate. Moreover, it maintains 87% accuracy with a 2.1% false positive rate when trained on just 10% of the COCO data. ClipGrader also scales effectively to larger datasets such as LVIS, achieving 79% accuracy across 1,203 classes. Our experiments demonstrate ClipGrader's ability to identify errors in existing COCO annotations, highlighting its potential for dataset refinement. When integrated into a semi-supervised object detection (SSOD) model, ClipGrader readily improves the pseudo label quality, helping achieve higher mAP (mean Average Precision) throughout the training process. ClipGrader thus provides a scalable AI-assisted tool for enhancing annotation quality control and verifying annotations in large-scale object detection datasets.

目标检测标注质量CLIP半监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。