arXiv:2604.22199cs.ROcs.AI2026-04

机器人通过闭环学习自动积累新任务经验,减少对大模型的依赖。

An LLM-Driven Closed-Loop Autonomous Learning Framework for Robots Facing Uncovered Tasks in Open Environments

论文配图:An LLM-Driven Closed-Loop Autonomous Learning Framework for Robots Facing Uncovered Tasks in Open Environments
图 1 · 摘自论文原文
  • 用大模型分析任务并规划学习路径,实现自主迭代。
  • 自执行与观察双路径学习,将经验转为可复用本地方法。
  • 实验显示执行时间降13%,大模型调用次数减少80%。

在开放环境中运行的自主机器人需持续应对未预设的任务。现有方法常依赖重复的大语言模型(LLM)交互,且成功执行或外部观察行为难以自动转化为可复用的本地知识。本文提出一种基于大模型的闭环自主学习框架,用于处理开放环境中的未覆盖任务。该框架首先检索本地方法库,判断是否存在可复用解决方案;若无,则触发自主学习流程:大模型作为高层推理组件,负责任务分析、候选模型选择、数据收集规划及执行/观察策略制定。机器人通过自执行和主动观察双重方式学习,进行准实时训练与调整,并将验证结果固化至本地方法库供未来使用。通过此循环过程,机器人逐步将执行与观察所得经验转化为可复用的本地能力,同时降低对重复外部大模型交互的依赖。实验表明,该框架在重复任务自执行与基于观察的设置中均显著缩短执行时间并减少大模型调用:例如,在重复任务自执行实验中,平均总执行时间从7.7772秒降至6.7779秒,每任务平均大模型调用次数从1.0次降至0.2次。

原文摘要 · Abstract (English)

Autonomous robots operating in open environments need the ability to continuously handle tasks that are not covered by predefined local methods. However, existing approaches often rely on repeated large-language-model (LLM) interaction for uncovered tasks, and even successful executions or observed successful external behaviors are not always autonomously transformed into reusable local knowledge. In this paper, we propose an LLM-driven closed-loop autonomous learning framework for robots facing uncovered tasks in open environments. The proposed framework first retrieves the local method library to determine whether a reusable solution already exists for the current task or observed event. If no suitable method is found, it triggers an autonomous learning process in which the LLM serves as a high-level reasoning component for task analysis, candidate model selection, data collection planning, and execution or observation strategy organization. The robot then learns from both self-execution and active observation, performs quasi-real-time training and adjustment, and consolidates the validated result into the local method library for future reuse. Through this recurring closed-loop process, the robot gradually converts both execution-derived and observation-derived experience into reusable local capability while reducing future dependence on repeated external LLM interaction. Results show that the proposed framework reduces execution time and LLM dependence in both repeated-task self-execution and observation-driven settings, for example reducing the average total execution time from 7.7772s to 6.7779s and the average number of LLM calls per task from 1.0 to 0.2 in the repeated-task self-execution experiments.

自主学习机器人大模型闭环系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。