arXiv:2410.06108cs.AI2024-10ICRA被引 11

用大模型规划机器人任务,解决其因幻觉导致的执行失败问题。

ConceptAgent: LLM-Driven Precondition Grounding and Tree Search for Robust Task Planning and Execution

  • 通过谓词实体化确保动作可行性,避免低级错误
  • 结合自反思的树搜索策略,任务完成率提升19%
  • 适合需要高可靠性的复杂环境机器人系统

在开放世界环境中,机器人规划与执行面临状态空间庞大、任务实现方式多变的挑战。尽管感知算法进步与大语言模型(LLMs)用于规划带来了新希望,但其生成内容可能包含逻辑谬误,导致计划无法执行。为应对这一问题,我们提出ConceptAgent——一个以自然语言驱动的机器人平台,专注于在复杂状态和动作空间中实现可扩展、可靠的自动化。创新包括:1)谓词实体化,预防并恢复不可行动作;2)带有自我反思的具身版LLM引导蒙特卡洛树搜索。在模拟实验中,ConceptAgent在三个房间布局和30个简单层级任务上实现了19%的任务完成率,优于其他先进基线(分别为10.26%和8.11%)。对中等至困难任务的消融研究显示,相比基线,增强后的ConceptAgent任务完成率提升20%,验证了两项技术各自的贡献及其协同效应。

原文摘要 · Abstract (English)

Robotic planning and execution in open-world environments is a complex problem due to the vast state spaces and high variability of task embodiment. Recent advances in perception algorithms, combined with Large Language Models (LLMs) for planning, offer promising solutions to these challenges, as the common sense reasoning capabilities of LLMs provide a strong heuristic for efficiently searching the action space. However, prior work fails to address the possibility of hallucinations from LLMs, which results in failures to execute the planned actions largely due to logical fallacies at high- or low-levels. To contend with automation failure due to such hallucinations, we introduce ConceptAgent, a natural language-driven robotic platform designed for task execution in unstructured environments. With a focus on scalability and reliability of LLM-based planning in complex state and action spaces, we present innovations designed to limit these shortcomings, including 1) Predicate Grounding to prevent and recover from infeasible actions, and 2) an embodied version of LLM-guided Monte Carlo Tree Search with self reflection. In simulation experiments, ConceptAgent achieved a 19% task completion rate across three room layouts and 30 easy level embodied tasks outperforming other state-of-the-art LLM-driven reasoning baselines that scored 10.26% and 8.11% on the same benchmark. Additionally, ablation studies on moderate to hard embodied tasks revealed a 20% increase in task completion from the baseline agent to the fully enhanced ConceptAgent, highlighting the individual and combined contributions of Predicate Grounding and LLM-guided Tree Search to enable more robust automation in complex state and action spaces.

机器人大模型规划可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。