用视觉语言模型自动生成标注,让目标检测无需人工标数据。
Auto-Labeling Data for Object Detection
- 用预训练视觉语言模型生成特定任务的伪标签
- 在多个数据集上保持竞争力,标注成本大幅降低
- 适合需要快速部署、资源受限的实用场景
优质标注造就优秀模型。然而,传统目标检测的标注方式在大规模应用下成本高昂。现有替代方案要么功能受损,要么需大型模型带来不可接受的推理开销。本文提出无需真实标注即可训练标准目标检测模型的方法:利用已训练的视觉-语言基础模型生成适用于具体任务的伪“真实标签”。这些自动生成的标签可直接接入现有训练框架,随后训练轻量级检测模型,兼顾计算效率。通过在多种标注配置、下游模型和数据集上的广泛实验,我们建立了最佳实践并设立了全面的自动标注基准。结果表明,该方法在多个数据集上表现良好,显著降低标注时间与成本,是传统标注的有效替代方案。
原文摘要 · Abstract (English)
Great labels make great models. However, traditional labeling approaches for tasks like object detection have substantial costs at scale. Furthermore, alternatives to fully-supervised object detection either lose functionality or require larger models with prohibitive computational costs for inference at scale. To that end, this paper addresses the problem of training standard object detection models without any ground truth labels. Instead, we configure previously-trained vision-language foundation models to generate application-specific pseudo "ground truth" labels. These auto-generated labels directly integrate with existing model training frameworks, and we subsequently train lightweight detection models that are computationally efficient. In this way, we avoid the costs of traditional labeling, leverage the knowledge of vision-language models, and keep the efficiency of lightweight models for practical application. We perform exhaustive experiments across multiple labeling configurations, downstream inference models, and datasets to establish best practices and set an extensive auto-labeling benchmark. From our results, we find that our approach is a viable alternative to standard labeling in that it maintains competitive performance on multiple datasets and substantially reduces labeling time and costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。