用热成像和深度学习实时预警车辆撞鹿,降低事故风险。
Real-time Deer Detection and Warning in Connected Vehicles via Thermal Sensing and Deep Learning
- 结合热成像与深度学习,实现高精度鹿类实时检测。
- 平均精度达98.84%,在恶劣天气下检测准确率仍超88%。
- 适合智能网联汽车系统集成,尤其适用于鹿多发区域。
鹿车碰撞是美国的重大安全挑战,每年造成约210万起事故,导致近440人死亡、5.9万人受伤,经济损失达100亿美元,并加剧鹿群数量下降。本文提出一种融合热成像、深度学习与车联万物通信的实时检测与驾驶预警系统,以缓解此类事故。系统基于在北卡罗来纳州马斯希尔采集的超过1.2万张热成像鹿图像数据集进行训练与验证。实验表明,系统平均精度达98.84%,精确率为95.44%,召回率为95.96%。实地测试中,系统成功感知鹿群并向驾驶员发出提前预警。在复杂天气条件下,热成像检测准确率保持在88%至92%之间,而传统可见光摄像头有效性低于60%。当检测置信度超过阈值时,通过蜂窝车联网(CV2X)向周边车辆与路侧单元广播传感器数据。整体端到端延迟稳定低于100毫秒。该研究为利用热成像与智能网联技术减少鹿车碰撞提供了可行路径。
原文摘要 · Abstract (English)
Deer-vehicle collisions represent a critical safety challenge in the United States, causing nearly 2.1 million incidents annually and resulting in approximately 440 fatalities, 59,000 injuries, and 10 billion USD in economic damages. These collisions also contribute significantly to declining deer populations. This paper presents a real-time detection and driver warning system that integrates thermal imaging, deep learning, and vehicle-to-everything communication to help mitigate deer-vehicle collisions. Our system was trained and validated on a custom dataset of over 12,000 thermal deer images collected in Mars Hill, North Carolina. Experimental evaluation demonstrates exceptional performance with 98.84 percent mean average precision, 95.44 percent precision, and 95.96 percent recall. The system was field tested during a follow-up visit to Mars Hill and readily sensed deer providing the driver with advanced warning. Field testing validates robust operation across diverse weather conditions, with thermal imaging maintaining between 88 and 92 percent detection accuracy in challenging scenarios where conventional visible light based cameras achieve less than 60 percent effectiveness. When a high probability threshold is reached sensor data sharing messages are broadcast to surrounding vehicles and roadside units via cellular vehicle to everything (CV2X) communication devices. Overall, our system achieves end to end latency consistently under 100 milliseconds from detection to driver alert. This research establishes a viable technological pathway for reducing deer-vehicle collisions through thermal imaging and connected vehicles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。