用红外图像自动标注低光行人检测数据,效果优于人工标注。
Automatic Labelling for Low-Light Pedestrian Detection
- 通过红外图像检测后迁移标签到RGB图像,实现自动标注。
- 在KAIST数据集上,自动生成标签训练的模型在6项指标中5项超越人工标注。
- 适合缺乏标注数据的低光行人检测研究者快速构建数据集。
RGB图像中的行人检测是自动驾驶和高级驾驶辅助系统中的关键任务,但低光条件下的行人检测缺乏大规模公开数据集和自动化标注流程。本文提出一种基于红外-RGB的自动化标注管道:首先使用微调的红外行人检测模型进行检测,然后将红外检测结果映射到对应的RGB图像,最后利用生成的标签训练低光条件下的人行检测模型。实验在KAIST数据集上进行,对比了DETR、YOLO和RCNN三种模型在生成标签与真实标签上的表现。在未见过的测试图像上,使用生成标签训练的模型在mAP@50和LAMR指标上优于真实标签的模型,在5/6的情况下表现更优;在mAP@50-95指标上则全部超越。结果表明,该自动标注方法可有效扩展低光行人检测数据集。代码已开源:https://github.com/BouzoulasDimitrios/IR-RGB-autoamed-low-light-pedestrian-labelling。
原文摘要 · Abstract (English)
Pedestrian detection in RGB images is a key task in pedestrian safety, as the most common sensor in autonomous vehicles and advanced driver assistance systems is the RGB camera. Low-light pedestrian detection lacks large public datasets and autolabelling pipelines. This research proposes a solution in the form of an automated infrared-RGB pipeline. The pipeline consists of 1) Infrared detection, where a fine-tuned model for infrared pedestrian detection is used 2) Label transfer process from the infrared detections to their RGB counterparts 3) Training object detection models using the generated labels for low-light RGB pedestrian detection. The research was performed using the KAIST dataset. For evaluation, three object detection models, DETR, YOLO, and RCNN, were trained on generated and ground truth labels. When compared on previously unseen images, the results showed that the models trained on generated labels out-performed the ones trained on ground-truth in 5 out of 6 cases for the mAP@50 and LAMR metrics, and outperformed ground-truth on mAP@50-95 in all cases. Acquired results indicate that the proposed auto-labelling pipeline could be used for scalable annotation of low-light datasets for pedestrian detection. The source code for this research is available on GitHub: https://github.com/BouzoulasDimitrios/IR-RGB-autoamed-low-light-pedestrian-labelling
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。