arXiv:2603.05729cs.CV2026-03中稿 · CVPR

用自动化方法为ImageNet训练集添加多标签,提升模型性能。

Unlocking ImageNet's Multi-Object Nature: Automated Large-Scale Multilabel Annotation

  • 用自监督ViT发现图像中的多个物体,自动标注多标签。
  • 多标签训练使分类准确率最高提升2.0,迁移任务指标提升4.2。
  • 适合关注视觉表征学习与数据标注质量的研究者。

原始ImageNet基准采用单标签假设,尽管许多图像包含多个物体,导致标签噪声并限制学习信号的丰富性。多标签标注更贴近真实视觉场景,有助于模型学习更丰富、鲁棒的表示。现有工作(如ReaL、ImageNetv2)虽改进了验证集,但尚未有高质、可扩展的训练集多标签标注。本文提出全自动流程,将ImageNet训练集转化为多标签数据集,无需人工标注。利用自监督视觉变压器进行无监督物体发现,选取与原标签对齐区域训练轻量分类器,并将其应用于所有区域,生成全数据集一致的多标签标注。定性评估显示标签与人类判断高度一致,定量测试表明,相比传统单标签方案,使用多标签监督的模型在多种架构上实现更高域内准确率(ReaL提升+2.0,ImageNet-V2提升+1.5),并在下游任务中表现更强迁移能力(COCO提升+4.2,VOC提升+2.3 mAP)。结果证明精准多标签标注对提升分类性能与表征学习的重要性。项目代码与生成的多标签标注已开源。

原文摘要 · Abstract (English)

The original ImageNet benchmark enforces a single-label assumption, despite many images depicting multiple objects. This leads to label noise and limits the richness of the learning signal. Multi-label annotations more accurately reflect real-world visual scenes, where multiple objects co-occur and contribute to semantic understanding, enabling models to learn richer and more robust representations. While prior efforts (e.g., ReaL, ImageNetv2) have improved the validation set, there has not yet been a scalable, high-quality multi-label annotation for the training set. To this end, we present an automated pipeline to convert the ImageNet training set into a multi-label dataset, without human annotations. Using self-supervised Vision Transformers, we perform unsupervised object discovery, select regions aligned with original labels to train a lightweight classifier, and apply it to all regions to generate coherent multi-label annotations across the dataset. Our labels show strong alignment with human judgment in qualitative evaluations and consistently improve performance across quantitative benchmarks. Compared to traditional single-label scheme, models trained with our multi-label supervision achieve consistently better in-domain accuracy across architectures (up to +2.0 top-1 accuracy on ReaL and +1.5 on ImageNet-V2) and exhibit stronger transferability to downstream tasks (up to +4.2 and +2.3 mAP on COCO and VOC, respectively). These results underscore the importance of accurate multi-label annotations for enhancing both classification performance and representation learning. Project code and the generated multi-label annotations are available at https://github.com/jchen175/MultiLabel-ImageNet.

多标签标注ImageNet自监督学习数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。