让机器人通过主动交互在复杂环境里自建路径到达目标。
AINav: Large Language Model-Based Adaptive Interactive Navigation
- 用大模型构建任务规划的技能树,智能判断该动什么物体、怎么动。
- 预训练多功能行为库,确保动作执行稳定可靠。
- 双大模型动态调整计划,适合未知复杂场景的机器人导航。
复杂环境中的机器人导航仍是关键挑战。传统方法依赖固定自由空间生成最优路径,难以应对灾难现场或堆满货物仓库等无可行路径的场景。为此,我们提出AINav,一种基于大语言模型的自适应交互式导航方法,能主动与环境互动以创建可达路径。具体而言,我们设计了一种用于任务规划的原始技能树,结合大语言模型实现有效推理,确定交互对象及其顺序。为保证子任务执行鲁棒性,采用强化学习预训练包含多种移动与交互行为的完整技能库,用于运动规划。此外,引入一种自适应重规划机制,包含两个基于大语言模型的模块:顾问模块作为灵活的重规划触发器,园丁模块实现自主计划调整。结合树状结构,该机制支持节点的便捷增删,使计划能在事前未知环境中快速适应。大量仿真与实验证明了AINav在多样化场景下的有效性与自适应能力。补充视频见:https://youtu.be/CjXm5KFx9AI。
原文摘要 · Abstract (English)
Robotic navigation in complex environments remains a critical research challenge. Traditional navigation methods focus on optimal trajectory generation within fixed free workspace, therefore struggling in environments lacking viable paths to the goal, such as disaster zones or cluttered warehouses. To address this problem, we propose AINav, an adaptive interactive navigation approach that proactively interacts with environments to create feasible paths to achieve originally unreachable goals. Specifically, we present a primitive skill tree for task planning with large language models (LLMs), facilitating effective reasoning to determine interaction objects and sequences. To ensure robust subtask execution, we adopt reinforcement learning to pre-train a comprehensive skill library containing versatile locomotion and interaction behaviors for motion planning. Furthermore, we introduce an adaptive replanning approach featuring two LLM-based modules: an advisor serving as a flexible replanning trigger and an arborist for autonomous plan adjustment. Integrated with the tree structure, the replanning mechanism allows for convenient node addition and pruning, enabling rapid plan adaptation in a priori unknown environments. Comprehensive simulations and experiments have demonstrated AINav's effectiveness and adaptivity in diverse scenarios. The supplementary video is available at: https://youtu.be/CjXm5KFx9AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。