用合成数据提升夜间车辆检测,无需人工标注
Enhancing Nighttime Vehicle Detection with Day-to-Night Style Transfer and Labeling-Free Augmentation
- 用CARLA生成昼夜风格迁移数据,模拟真实夜间光照
- 在农村夜间场景中,模型检测准确率显著提升
- 适合低光环境下自动驾驶目标检测任务
现有深度学习目标检测模型在白天表现良好,但在夜间因训练数据不足而性能下降。夜间图像标注困难,尤其在缺乏路灯的乡村道路,车灯眩光更难识别。本文提出一种无标注数据增强框架,利用CARLA生成的合成数据实现昼夜风格迁移。通过高效注意力生成对抗网络生成逼真夜间图像,并引入车灯效果以帮助模型学习。在定制化的乡村夜间数据集上微调YOLO11模型,显著提升了夜间车辆检测性能。该方法简单有效,可扩展至多种低可见度场景,增强检测系统实际应用能力。
原文摘要 · Abstract (English)
Existing deep learning-based object detection models perform well under daytime conditions but face significant challenges at night, primarily because they are predominantly trained on daytime images. Additionally, training with nighttime images presents another challenge: even human annotators struggle to accurately label objects in low-light conditions. This issue is particularly pronounced in transportation applications, such as detecting vehicles and other objects of interest on rural roads at night, where street lighting is often absent, and headlights may introduce undesirable glare. This study addresses these challenges by introducing a novel framework for labeling-free data augmentation, leveraging CARLA-generated synthetic data for day-to-night image style transfer. Specifically, the framework incorporates the Efficient Attention Generative Adversarial Network for realistic day-to-night style transfer and uses CARLA-generated synthetic nighttime images to help the model learn vehicle headlight effects. To evaluate the efficacy of the proposed framework, we fine-tuned the YOLO11 model with an augmented dataset specifically curated for rural nighttime environments, achieving significant improvements in nighttime vehicle detection. This novel approach is simple yet effective, offering a scalable solution to enhance AI-based detection systems in low-visibility environments and extend the applicability of object detection models to broader real-world contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。