用视觉语言模型预判动态危险,让机器人提前避险。
Language as Cost: Proactive Hazard Mapping using VLM for Robot Navigation
- 用VLM分析场景,把语言描述的风险转为导航代价
- 在模拟环境中导航成功率提升,危险遭遇减少47%
- 适合需要主动避障的智能机器人应用
在人机共存或危险环境中运行的机器人需主动预判并规避风险,而非仅依赖静态地图进行障碍物检测。传统导航系统常因缺乏对动态风险(如突然开启的门后出现的人)的感知而反应滞后。近年来,预训练大语言模型和视觉语言模型(VLMs)的发展为前瞻性风险规避提供了新可能。本文提出一种零样本的“语言即代价”(Language as Cost, LaC)映射框架,利用VLM解析视觉场景,评估潜在动态风险,并预先分配风险感知的导航代价,使机器人能在危险发生前完成路径规划。通过将该语言代价图与几何障碍图融合,机器人不仅能识别已有障碍,还能主动规划避开由环境动态引发的潜在危险。在多种模拟动态环境中的实验表明,相比传统反应式基线规划器,本方法显著提升了导航成功率并减少了47%的危险遭遇。代码与补充材料见:https://github.com/Taekmino/LaC。
原文摘要 · Abstract (English)
Robots operating in human-centric or hazardous environments must proactively anticipate and mitigate dangers beyond basic obstacle detection. Traditional navigation systems often depend on static maps, which struggle to account for dynamic risks, such as a person emerging from a suddenly opening door. As a result, these systems tend to be reactive rather than anticipatory when handling dynamic hazards. Recent advancements in pre-trained large language models and vision-language models (VLMs) create new opportunities for proactive hazard avoidance. In this work, we propose a zero-shot language-as-cost mapping framework that leverages VLMs to interpret visual scenes, assess potential dynamic risks, and assign risk-aware navigation costs preemptively, enabling robots to anticipate hazards before they materialize. By integrating this language-based cost map with a geometric obstacle map, the robot not only identifies existing obstacles but also anticipates and proactively plans around potential hazards arising from environmental dynamics. Experiments in simulated and diverse dynamic environments demonstrate that the proposed method significantly improves navigation success rates and reduces hazard encounters, compared to reactive baseline planners. Code and supplementary materials are available at https://github.com/Taekmino/LaC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。