用知识增强大模型,让机器人更懂复杂任务的逻辑顺序。
LLM-guided Task and Motion Planning using Knowledge-based Reasoning
- 用领域知识扩展提示词,让大模型生成更符合场景的任务计划
- 在仿真和真实环境中显著提升动态适应能力和计划正确率
- 适合研究智能机器人规划与大模型交互的开发者
在动态环境中执行复杂操作任务需要高效的任务与运动规划(TAMP)方法,将高层符号规划与底层运动控制结合。大语言模型(如GPT-4)通过自然语言描述任务、生成符号计划和推理,正推动任务规划的变革。然而,现有基于LLM的TAMP方法受限于静态模板化提示,难以适应动态环境和复杂任务上下文。为此,本文提出一种新型Onto-LLM-TAMP框架,通过基于知识的推理,对用户提示进行任务上下文关联的细化与扩展,并融入环境状态的知识描述。将领域知识注入提示中,确保任务计划语义准确且上下文敏感。该框架在包含层级物体放置等场景中有效纠正符号计划生成中的语义错误,保持逻辑时间顺序。在仿真与真实场景中验证,相比基线方法,在动态环境适应性和生成语义正确计划方面均有显著提升。
原文摘要 · Abstract (English)
Performing complex manipulation tasks in dynamic environments requires efficient Task and Motion Planning (TAMP) approaches that combine high-level symbolic plans with low-level motion control. Advances in Large Language Models (LLMs), such as GPT-4, are transforming task planning by offering natural language as an intuitive and flexible way to describe tasks, generate symbolic plans, and reason. However, the effectiveness of LLM-based TAMP approaches is limited due to static and template-based prompting, which limits adaptability to dynamic environments and complex task contexts. To address these limitations, this work proposes a novel Onto-LLM-TAMP framework that employs knowledge-based reasoning to refine and expand user prompts with task-contextual reasoning and knowledge-based environment state descriptions. Integrating domain-specific knowledge into the prompt ensures semantically accurate and context-aware task plans. The proposed framework demonstrates its effectiveness by resolving semantic errors in symbolic plan generation, such as maintaining logical temporal goal ordering in scenarios involving hierarchical object placement. The proposed framework is validated through both simulation and real-world scenarios, demonstrating significant improvements over the baseline approach in terms of adaptability to dynamic environments and the generation of semantically correct task plans.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。