用热成像识别行动障碍者,自动调整红绿灯时长,提升无障碍通行。
Thermal Detection of People with Mobility Restrictions for Barrier Reduction at Traffic Lights Controlled Intersections
- 基于热成像与YOLO改进模型,实现恶劣环境下精准行人检测。
- 在自建数据集TD4PWMR上,对行动障碍者检测准确率显著提升。
- 适合城市交通智能化、无障碍设计研究者参考应用。
深度学习推动了基于RGB相机的自适应交通灯系统在提升交通安全和行人舒适度方面的应用,但这类系统常忽视行动障碍者的需求。同时,RGB相机在恶劣天气或低光照条件下性能下降,且存在隐私风险。为此,本文提出一种全自动热成像检测驱动的交通灯系统,可动态调整信号时长以适应步行困难者,并为视障人士触发语音提示,助力实现全人群无障碍交叉口。为此,我们构建了面向行动障碍者的热成像数据集TD4PWMR,涵盖不同光照、天气及高密度城市环境下的多样行人场景,尤其关注使用助行工具或有行动负担者。尽管热成像具备隐私保护和环境鲁棒性优势,但其缺乏颜色与纹理细节、分辨率较低,给目标检测带来挑战。为此,我们提出YOLO-Thermal,一种融合先进特征提取与注意力机制的YOLO变体,显著提升热成像下的检测精度与鲁棒性。实验表明,所提检测器优于现有方法,交通灯系统有效改善无障碍通行体验。代码与数据集已开源:https://github.com/leon2014dresden/YOLO-THERMAL。
原文摘要 · Abstract (English)
Rapid advances in deep learning for computer vision have driven the adoption of RGB camera-based adaptive traffic light systems to improve traffic safety and pedestrian comfort. However, these systems often overlook the needs of people with mobility restrictions. Moreover, the use of RGB cameras presents significant challenges, including limited detection performance under adverse weather or low-visibility conditions, as well as heightened privacy concerns. To address these issues, we propose a fully automated, thermal detector-based traffic light system that dynamically adjusts signal durations for individuals with walking impairments or mobility burden and triggers the auditory signal for visually impaired individuals, thereby advancing towards barrier-free intersection for all users. To this end, we build the thermal dataset for people with mobility restrictions (TD4PWMR), designed to capture diverse pedestrian scenarios, particularly focusing on individuals with mobility aids or mobility burden under varying environmental conditions, such as different lighting, weather, and crowded urban settings. While thermal imaging offers advantages in terms of privacy and robustness to adverse conditions, it also introduces inherent hurdles for object detection due to its lack of color and fine texture details and generally lower resolution of thermal images. To overcome these limitations, we develop YOLO-Thermal, a novel variant of the YOLO architecture that integrates advanced feature extraction and attention mechanisms for enhanced detection accuracy and robustness in thermal imaging. Experiments demonstrate that the proposed thermal detector outperforms existing detectors, while the proposed traffic light system effectively enhances barrier-free intersection. The source codes and dataset are available at https://github.com/leon2014dresden/YOLO-THERMAL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。