用视觉语言模型提升摩托骑行安全,实时生成避险路径。
VLM-Based Advanced Rider Assistance System for Motorcycle Safety

- 结合视觉语言模型与分割检测,构建细粒度风险地图。
- 在CARLA模拟中成功率更高,危险暴露降低37%以上。
- 适合自动驾驶摩托车、智能骑行辅助系统研发者。
相较于汽车,摩托车因防护不足且对路面状况更敏感,事故风险显著更高,但高级骑行辅助系统(ARAS)的发展远落后于高级驾驶辅助系统(ADAS)。本文提出一种新型ARAS,通过语义感知与风险感知规划提升骑行安全。该方法利用视觉语言模型(VLMs)进行上下文化危险推理,并融合基于分割的检测技术,构建密集风险地图。地图同时编码语义特征(如坑洼严重程度、积水滑溜性)和物理属性(如大小、深度),生成像素级风险代价,精准反映摩托车特有风险。这些地图由针对摩托车动力学优化的采样式规划器使用,推荐节气门与转向动作,以最小化风险暴露并抵达目的地。我们在CARLA仿真环境中评估了多种场景下的系统表现。相比基线方法,本方案在成功率上提升明显,危险暴露降低超37%,定性结果亦显示可解释的风险图与安全轨迹建议。
原文摘要 · Abstract (English)
Motorcycles face disproportionately high crash risks compared to cars due to limited protection and heightened sensitivity to surface hazards, yet Advanced Rider Assistance Systems (ARAS) remain underdeveloped relative to Advanced Driver Assistance Systems (ADAS). We propose a novel ARAS that enhances motorcycle safety through semantic perception and risk-aware planning. Our approach leverages Vision-Language Models (VLMs) for contextual hazard reasoning and integrates them with segmentation-based detection to construct dense risk maps. These maps encode both semantic characteristics (e.g., pothole severity, puddle slipperiness) and physical attributes (e.g., size, depth), which produce per-pixel hazard costs that capture motorcycle-specific risks. These maps are used by a sampling-based planner tailored to motorcycle dynamics to recommend throttle and steering actions that minimize hazard exposure while advancing toward the destination. We evaluate our system in different scenarios in the CARLA simulator. Compared to the baseline method, our method achieves higher success rates and lower hazard exposure, while qualitative results demonstrate interpretable risk maps and safe trajectory recommendations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。