用无标签数据预训练YOLO,显著降低对标注数据依赖
Self-Supervised YOLO: Leveraging Contrastive Learning for Label-Efficient Object Detection
- 将YOLO骨干网络改造成对比学习编码器,用SimCLR框架在12万张无标注图上预训练
- 在小样本骑行者检测任务中,预训练模型mAP达0.7663,优于有监督训练
- 特别适合标注成本高、数据稀缺的实时目标检测场景
单阶段目标检测器如YOLO系列在实时视觉应用中表现卓越,但严重依赖大规模标注数据。本文系统研究了对比自监督学习(SSL)在减少这一依赖方面的潜力,通过SimCLR框架在未标注的COCO数据集(12万张图像)上对YOLOv5和YOLOv8骨干网络进行预训练。方法将YOLO卷积骨干作为编码器,采用全局池化与投影头,并利用数据增强优化对比损失。预训练后,在标注数据有限的骑行者检测任务中微调,实验表明该方法带来更高的mAP、更快收敛及更优的精度-召回表现,尤其在低标注条件下优势明显。例如,使用无标注数据预训练的YOLOv8在mAP@50:95上达到0.7663,超越其监督训练版本。结果为单阶段检测器应用对比自监督学习建立了强基线,凸显无标注数据作为可扩展资源在标签高效检测中的潜力。
原文摘要 · Abstract (English)
One-stage object detectors such as the YOLO family achieve state-of-the-art performance in real-time vision applications but remain heavily reliant on large-scale labeled datasets for training. In this work, we present a systematic study of contrastive self-supervised learning (SSL) as a means to reduce this dependency by pretraining YOLOv5 and YOLOv8 backbones on unlabeled images using the SimCLR framework. Our approach introduces a simple yet effective pipeline that adapts YOLO's convolutional backbones as encoders, employs global pooling and projection heads, and optimizes a contrastive loss using augmentations of the COCO unlabeled dataset (120k images). The pretrained backbones are then fine-tuned on a cyclist detection task with limited labeled data. Experimental results show that SSL pretraining leads to consistently higher mAP, faster convergence, and improved precision-recall performance, especially in low-label regimes. For example, our SimCLR-pretrained YOLOv8 achieves a mAP@50:95 of 0.7663, outperforming its supervised counterpart despite using no annotations during pretraining. These findings establish a strong baseline for applying contrastive SSL to one-stage detectors and highlight the potential of unlabeled data as a scalable resource for label-efficient object detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。