用大模型推理常识,让机器人在看不清环境时也能高效规划任务。
Large-Language-Model-Guided State Estimation for Partially Observable Task and Motion Planning
- 用大模型推断物体常见位置和相似物共现规律,改进状态估计
- 仿真中规划执行时间减少62.7%,真实场景减少72.6%
- 适合复杂未知环境中需长期规划的机器人系统
部分可观测环境下机器人的规划极具挑战性,需在不确定中通过部分可观测马尔可夫决策过程进行推理。执行计划过程中,机器人可能意外发现与任务无关的物体,传统规划器通常忽略此类信息。本文提出引入两类常识知识:(1) 某些物体更可能出现在特定位置;(2) 相似物体更可能共存,不相似物体则较少共现。人工构建此类知识复杂,因此我们利用大语言模型(LLMs)强大的常识推理能力。提出的规划与执行框架CoCo-TAMP采用分层状态估计,借助LLM引导的信息来优化对任务相关物体的信念,从而高效解决长时程任务与运动规划问题。实验表明,相比未使用任何常识知识的基线,CoCo-TAMP在仿真中平均减少62.7%的规划与执行时间,在真实世界演示中减少72.6%。
原文摘要 · Abstract (English)
Robot planning in partially observable environments, where not all objects are known or visible, is a challenging problem, as it requires reasoning under uncertainty through partially observable Markov decision processes. During the execution of a computed plan, a robot may unexpectedly observe task-irrelevant objects, which are typically ignored by naive planners. In this work, we propose incorporating two types of common-sense knowledge: (1) certain objects are more likely to be found in specific locations; and (2) similar objects are likely to be co-located, while dissimilar objects are less likely to be found together. Manually engineering such knowledge is complex, so we explore leveraging the powerful common-sense reasoning capabilities of large language models (LLMs). Our planning and execution framework, CoCo-TAMP, introduces a hierarchical state estimation that uses LLM-guided information to shape the belief over task-relevant objects, enabling efficient solutions to long-horizon task and motion planning problems. In experiments, CoCo-TAMP achieves an average reduction of 62.7% in planning and execution time in simulation, and 72.6% in real-world demonstrations, compared to a baseline that does not incorporate either type of common-sense knowledge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。