让机器人从经验中学习并智能迁移策略,提升复杂任务执行能力。
ELITE: Experiential Learning and Intent-Aware Transfer for Self-improving Embodied Agents
- 通过自我反思构建可复用策略池,动态优化行动方案。
- 在EB-ALFRED和EB-Habitat上分别提升9%和5%性能,无需额外标注。
- 适合需要持续学习与跨任务迁移的自主智能体研究者。
视觉语言模型(VLMs)具备强大泛化能力,但基于它们构建的具身智能体在复杂任务中常跳过关键步骤、提出无效动作或重复错误。这源于VLM静态训练数据与具身任务物理交互之间的根本差距:VLM虽能从静态数据中学习丰富语义知识,却缺乏与环境互动的能力。为此,我们提出ELITE框架,包含{E}xperiential {L}earning和{I}ntent-aware {T}ransfer,使智能体能持续从自身环境交互经验中学习,并将知识迁移到程序相似的任务中。ELITE通过两个协同机制运行:自省式知识构建与意图感知检索。前者从执行轨迹中提取可复用策略,并通过结构化精炼操作维护动态策略池;后者从池中识别相关策略并应用于当前任务。在EB-ALFRED和EB-Habitat基准测试中,ELITE在无监督在线设置下分别比基础VLM提升9%和5%。在有监督设置下,其能有效泛化至未见任务类别,表现优于现有基于训练的方法。结果表明,ELITE有效弥合了语义理解与可靠动作执行之间的鸿沟。
原文摘要 · Abstract (English)
Vision-language models (VLMs) have shown remarkable general capabilities, yet embodied agents built on them fail at complex tasks, often skipping critical steps, proposing invalid actions, and repeating mistakes. These failures arise from a fundamental gap between the static training data of VLMs and the physical interaction for embodied tasks. VLMs can learn rich semantic knowledge from static data but lack the ability to interact with the world. To address this issue, we introduce ELITE, an embodied agent framework with {E}xperiential {L}earning and {I}ntent-aware {T}ransfer that enables agents to continuously learn from their own environment interaction experiences, and transfer acquired knowledge to procedurally similar tasks. ELITE operates through two synergistic mechanisms, \textit{i.e.,} self-reflective knowledge construction and intent-aware retrieval. Specifically, self-reflective knowledge construction extracts reusable strategies from execution trajectories and maintains an evolving strategy pool through structured refinement operations. Then, intent-aware retrieval identifies relevant strategies from the pool and applies them to current tasks. Experiments on the EB-ALFRED and EB-Habitat benchmarks show that ELITE achieves 9\% and 5\% performance improvement over base VLMs in the online setting without any supervision. In the supervised setting, ELITE generalizes effectively to unseen task categories, achieving better performance compared to state-of-the-art training-based methods. These results demonstrate the effectiveness of ELITE for bridging the gap between semantic understanding and reliable action execution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。