针对恶劣天气下自动驾驶目标检测难题,提出云边协同的YOLO改进模型。
YOLO-Vehicle-Pro: A Cloud-Edge Collaborative Framework for Object Detection in Autonomous Driving under Adverse Weather Conditions
- 融合图像与文本信息,提升复杂场景感知能力
- 雾天检测准确率达82.3% mAP@50,实时性满足车载需求
- 云边协同架构,兼顾精度与推理效率,适合智能车部署
随着自动驾驶技术的快速发展,高效精准的目标检测能力已成为保障系统安全可靠的关键。然而,在雾霾等低能见度环境下,传统目标检测算法性能显著下降,难以满足自动驾驶需求。为此,本文提出两个创新深度学习模型:面向自动驾驶场景的YOLO-Vehicle,通过多模态融合技术结合图像与文本信息进行检测;在此基础上,进一步推出增强版YOLO-Vehicle-Pro,引入改进的图像去雾算法,提升低能见度环境下的检测表现。此外,本文设计并实现了一套云边协同的目标检测系统,在边缘设备部署模型,并在复杂情况下将部分计算任务卸载至云端。实验结果表明,在KITTI数据集上,YOLO-Vehicle-v1s模型达到92.1%的准确率,检测速度为226 FPS,推理时间仅12ms,满足实时性要求;在Foggy Cityscapes数据集处理雾天图像时,YOLO-Vehicle-Pro模型取得82.3% mAP@50的高精度,检测速度保持43 FPS。
原文摘要 · Abstract (English)
With the rapid advancement of autonomous driving technology, efficient and accurate object detection capabilities have become crucial factors in ensuring the safety and reliability of autonomous driving systems. However, in low-visibility environments such as hazy conditions, the performance of traditional object detection algorithms often degrades significantly, failing to meet the demands of autonomous driving. To address this challenge, this paper proposes two innovative deep learning models: YOLO-Vehicle and YOLO-Vehicle-Pro. YOLO-Vehicle is an object detection model tailored specifically for autonomous driving scenarios, employing multimodal fusion techniques to combine image and textual information for object detection. YOLO-Vehicle-Pro builds upon this foundation by introducing an improved image dehazing algorithm, enhancing detection performance in low-visibility environments. In addition to model innovation, this paper also designs and implements a cloud-edge collaborative object detection system, deploying models on edge devices and offloading partial computational tasks to the cloud in complex situations. Experimental results demonstrate that on the KITTI dataset, the YOLO-Vehicle-v1s model achieved 92.1% accuracy while maintaining a detection speed of 226 FPS and an inference time of 12ms, meeting the real-time requirements of autonomous driving. When processing hazy images, the YOLO-Vehicle-Pro model achieved a high accuracy of 82.3% mAP@50 on the Foggy Cityscapes dataset while maintaining a detection speed of 43 FPS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。