用多传感器融合实时检测电单车路障,提升骑行安全。
Real-Time Roadway Obstacle Detection for Electric Scooters Using Deep Learning and Multi-Sensor Fusion
- 融合相机与IMU数据,识别六类路面障碍物。
- mAP达0.827,系统满足实时检测需求。
- 适合智能出行与自动驾驶研发人员参考。
电动滑板车在城市中日益普及,但其小轮子、无悬挂系统及对不平路面敏感,导致交通事故和伤害频发。尽管深度学习目标检测已广泛用于汽车安全,但在电单车障碍物检测中的应用仍属空白。本研究提出一种新型地面障碍物检测系统,集成RGB相机与深度相机,并利用惯性测量单元(IMU)测量垂直加速度,以识别路面振动,从而分类六类障碍:树枝、井盖、坑洼、松果、非方向性裂缝和截顶圆锥。所有传感器均集成于Intel RealSense D435i相机中。基于YOLO的深度学习模型结合深度数据估算障碍物距离。在七小时自然骑行数据集上评估,系统mAP达到0.827,表现优异且具备实时性能。该方法为提升电单车安全提供了有效方案。数据集可在https://zenodo.org/records/14583718获取,代码开源于https://github.com/Zeyang-Zheng/Real-Time-Roadway-Obstacle-Detection-for-Electric-Scooters。
原文摘要 · Abstract (English)
The increasing adoption of electric scooters (e-scooters) in urban areas has coincided with a rise in traffic accidents and injuries, largely due to their small wheels, lack of suspension, and sensitivity to uneven surfaces. While deep learning-based object detection has been widely used to improve automobile safety, its application for e-scooter obstacle detection remains unexplored. This study introduces a novel ground obstacle detection system for e-scooters, integrating an RGB camera, and a depth camera to enhance real-time road hazard detection. Additionally, the Inertial Measurement Unit (IMU) measures linear vertical acceleration to identify surface vibrations, guiding the selection of six obstacle categories: tree branches, manhole covers, potholes, pine cones, non-directional cracks, and truncated domes. All sensors, including the RGB camera, depth camera, and IMU, are integrated within the Intel RealSense Camera D435i. A deep learning model powered by YOLO detects road hazards and utilizes depth data to estimate obstacle proximity. Evaluated on the seven hours of naturalistic riding dataset, the system achieves a high mean average precision (mAP) of 0.827 and demonstrates excellent real-time performance. This approach provides an effective solution to enhance e-scooter safety through advanced computer vision and data fusion. The dataset is accessible at https://zenodo.org/records/14583718, and the project code is hosted on https://github.com/Zeyang-Zheng/Real-Time-Roadway-Obstacle-Detection-for-Electric-Scooters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。