arXiv:2409.08493cs.RO2024-09中稿 · IROS 2025被引 4

让机器人像人一样用语言和地图信息导航,提升智能决策能力。

Intelligent LiDAR Navigation: Leveraging External Information and Semantic Maps with LLM as Copilot

  • 用语义拓扑地图融合文本与激光数据,实现多源信息感知。
  • 引入大模型作为导航‘副驾驶’,可理解公告、门禁等外部信息。
  • 在真实场景中验证,支持动态环境下的自主路径规划。

传统机器人导航系统主要依赖占用栅格图和激光传感技术,如ROS中的move_base。与机器人不同,人类导航不仅依赖空间感知和距离判断,还会结合外部信息(如电梯维修公告)和经验知识(如某些门需特殊权限)。随着大语言模型(LLMs)在文本理解与智能水平上接近人类表现,为机器人导航系统注入类人认知能力成为可能。本研究提出使用osmAG(OpenStreetMap文本格式的区域图),一种创新的语义拓扑分层地图表示,以弥合ROS move_base能力与LLM提供的上下文理解之间的差距。方法上,将LLM实际作为导航副驾驶,整合更广泛的信息输入,同时保持传统机器人导航系统的鲁棒性。代码、演示、地图及实验结果见:https://github.com/xiexiexiaoxiexie/Intelligent-LiDAR-Navigation-LLM-as-Copilot。

原文摘要 · Abstract (English)

Traditional robot navigation systems primarily utilize occupancy grid maps and laser-based sensing technologies, as demonstrated by the popular move_base package in ROS. Unlike robots, humans navigate not only through spatial awareness and physical distances but also by integrating external information, such as elevator maintenance updates from public notification boards and experiential knowledge, like the need for special access through certain doors. With the development of Large Language Models (LLMs), which possesses text understanding and intelligence close to human performance, there is now an opportunity to infuse robot navigation systems with a level of understanding akin to human cognition. In this study, we propose using osmAG (Area Graph in OpensStreetMap textual format), an innovative semantic topometric hierarchical map representation, to bridge the gap between the capabilities of ROS move_base and the contextual understanding offered by LLMs. Our methodology employs LLMs as an actual copilot in robot navigation, enabling the integration of a broader range of informational inputs while maintaining the robustness of traditional robotic navigation systems. Our code, demo, map, experiment results can be accessed at https://github.com/xiexiexiaoxiexie/Intelligent-LiDAR-Navigation-LLM-as-Copilot.

机器人导航大模型应用语义地图智能感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。