让机器人通过反思错误持续改进,实现真正自主的闭环智能。
Think, Act, Learn: A Framework for Autonomous Robotic Agents using Closed-Loop Large Language Models
- 用思考-行动-学习循环让大模型在真实环境中不断迭代策略。
- 复杂长任务成功率超97%,平均9次尝试就稳定策略。
- 适合研究自主机器人、具身智能与大模型融合的学者。
将大语言模型(LLMs)引入机器人领域,使高层任务规划能力大幅提升。然而,当前多数系统采用开环模式,即大模型仅一次性生成计划,难以应对动态物理环境中的突发情况。为此,本文提出“思考-行动-学习”(T-A-L)框架,一种新型架构,使具身智能体可通过持续交互自主学习并优化策略。该框架构建闭环循环:大模型首先“思考”,将高层指令分解为可执行计划;机器人“行动”并收集丰富的多模态感官反馈;关键在于,“学习”模块处理反馈,支持大模型驱动的自我反思,对失败进行因果分析并生成修正策略。这些经验存入经验记忆,指导未来规划周期。在仿真和真实世界中大量实验表明,该框架显著优于基线方法(包括开环大模型、行为克隆与传统强化学习),在复杂长时序任务中成功率超过97%,平均仅需9次试验即可收敛至稳定策略,并展现出对未见任务的强大泛化能力。这项工作为开发更鲁棒、自适应、真正自主的机器人智能体迈出关键一步。
原文摘要 · Abstract (English)
The integration of Large Language Models (LLMs) into robotics has unlocked unprecedented capabilities in high-level task planning. However, most current systems operate in an open-loop fashion, where LLMs act as one-shot planners, rendering them brittle and unable to adapt to unforeseen circumstances in dynamic physical environments. To overcome this limitation, this paper introduces the "Think, Act, Learn" (T-A-L) framework, a novel architecture that enables an embodied agent to autonomously learn and refine its policies through continuous interaction. Our framework establishes a closed-loop cycle where an LLM first "thinks" by decomposing high-level commands into actionable plans. The robot then "acts" by executing these plans while gathering rich, multimodal sensory feedback. Critically, the "learn" module processes this feedback to facilitate LLM-driven self-reflection, allowing the agent to perform causal analysis on its failures and generate corrective strategies. These insights are stored in an experiential memory to guide future planning cycles. We demonstrate through extensive experiments in both simulation and the real world that our T-A-L agent significantly outperforms baseline methods, including open-loop LLMs, Behavioral Cloning, and traditional Reinforcement Learning. Our framework achieves over a 97% success rate on complex, long-horizon tasks, converges to a stable policy in an average of just 9 trials, and exhibits remarkable generalization to unseen tasks. This work presents a significant step towards developing more robust, adaptive, and truly autonomous robotic agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。