CLEA让机器人在动态环境中更可靠地完成复杂任务。
CLEA: Closed-Loop Embodied Agent for Enhancing Task Execution in Dynamic Environments
- 用四个专用大模型构建闭环控制,动态生成可执行子任务。
- 实测成功率达67.3%提升,任务完成率提高52.8%。
- 适合需要高鲁棒性的现实机器人任务系统。
大型语言模型(LLMs)在通过语义推理进行复杂任务的层次化分解方面表现出色。然而,在具身系统中应用时,其子任务序列的可靠执行和长期任务的一次性成功仍面临挑战。为解决动态环境中的这些局限,我们提出闭合回路具身智能体(CLEA)——一种采用四个功能解耦的开源LLM的新架构,实现闭环任务管理。该框架包含两项核心创新:(1) 交互式任务规划器,根据环境记忆动态生成可执行子任务;(2) 多模态执行评估器,采用概率评估框架判断动作可行性,当环境扰动超过预设阈值时触发分层重规划机制。为验证CLEA的有效性,我们在真实环境中使用两台异构机器人开展物体搜索、操作及搜-操一体化任务实验。在12次任务测试中,CLEA优于基线模型,成功率提升67.3%,任务完成率提高52.8%。结果表明,CLEA显著增强了动态环境中任务规划与执行的鲁棒性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) exhibit remarkable capabilities in the hierarchical decomposition of complex tasks through semantic reasoning. However, their application in embodied systems faces challenges in ensuring reliable execution of subtask sequences and achieving one-shot success in long-term task completion. To address these limitations in dynamic environments, we propose Closed-Loop Embodied Agent (CLEA) -- a novel architecture incorporating four specialized open-source LLMs with functional decoupling for closed-loop task management. The framework features two core innovations: (1) Interactive task planner that dynamically generates executable subtasks based on the environmental memory, and (2) Multimodal execution critic employing an evaluation framework to conduct a probabilistic assessment of action feasibility, triggering hierarchical re-planning mechanisms when environmental perturbations exceed preset thresholds. To validate CLEA's effectiveness, we conduct experiments in a real environment with manipulable objects, using two heterogeneous robots for object search, manipulation, and search-manipulation integration tasks. Across 12 task trials, CLEA outperforms the baseline model, achieving a 67.3% improvement in success rate and a 52.8% increase in task completion rate. These results demonstrate that CLEA significantly enhances the robustness of task planning and execution in dynamic environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。