arXiv:2410.03035cs.ROcs.AI2024-10ICRA被引 31

让机器人在未完整描述任务时,边探索边理解并规划复杂户外任务。

SPINE: Online Semantic Planning for Missions with Incomplete Natural Language Specifications in Unstructured Environments

  • 用大模型解析自然语言任务,推断隐含子任务并在线生成计划。
  • 在2万平米杂乱户外环境实测,效率比现有方法快一倍以上,少需用户干预。
  • 适合无预建地图的复杂场景,如救援、巡检等需自主推理的任务。

随着机器人能力提升,用户希望用自然语言描述高层任务,由机器人自行推断细节。由于许多真实场景难以获取预建地图,完成此类任务需机器人在线建图与规划。尽管已有语义规划方法支持在线运行,但通常仅适用于明确指令(如找物体或探索)。近期大型语言模型(LLMs)在自然语言任务中展现出强大的上下文推理能力。然而,现有基于LLM的规划器通常不支持在线规划或复杂任务;相关子任务和语义信息依赖预建地图或用户输入。为此,我们提出SPINE——一种针对自然语言任务描述不完整情况的在线语义规划系统。该系统利用LLM推理任务中隐含的子任务,并在滚动视野框架中实现这些任务。任务通过新地图观测实时验证安全性并动态优化。我们在模拟与真实世界环境中评估了SPINE,任务涉及多个层级的语义推理和在超过20,000平方米的杂乱室外环境中的探索。相比现有基于LLM的规划方法,本方法在时间与距离上效率提升超两倍,减少用户交互,且无需完整地图。更多资源见https://zacravichandran.github.io/SPINE。

原文摘要 · Abstract (English)

As robots become increasingly capable, users will want to describe high-level missions and have robots infer the relevant details. Because pre-built maps are difficult to obtain in many realistic settings, accomplishing such missions will require the robot to map and plan online. While many semantic planning methods operate online, they are typically designed for well specified missions such as object search or exploration. Recently, Large Language Models (LLMs) have demonstrated powerful contextual reasoning abilities over a range of robotic tasks described in natural language. However, existing LLM-enabled planners typically do not consider online planning or complex missions; rather, relevant subtasks and semantics are provided by a pre-built map or a user. We address these limitations via SPINE, an online planner for missions with incomplete mission specifications provided in natural language. The planner uses an LLM to reason about subtasks implied by the mission specification and then realizes these subtasks in a receding horizon framework. Tasks are automatically validated for safety and refined online with new map observations. We evaluate SPINE in simulation and real-world settings with missions that require multiple steps of semantic reasoning and exploration in cluttered outdoor environments of over 20,000m$^2$. Compared to baselines that use existing LLM-enabled planning approaches, our method is over twice as efficient in terms of time and distance, requires less user interactions, and does not require a full map. Additional resources are provided at https://zacravichandran.github.io/SPINE.

语义规划大模型在线建图自然语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。