让机器人通过反思自身行为,自动优化操作技能。
EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agents

- 基于动作轨迹进行技能反思,区分错误内容与执行失误
- 在ALFWorld上使任务成功率提升至93.28%,超越大模型直接代理
- 无需训练即可自进化,适合需要长期自主学习的机器人系统
具身智能体可借助技能指导物体搜索、动作执行和状态变化。由于环境布局、物体状态等因素多样,这些技能需从任务执行轨迹中自我演化。现有方法多用于数字环境,常将轨迹粗略转化为技能更新,直接应用于具身场景存在缺陷:任务失败可能源于技能错误或执行偏差。本文提出EmbodiSkill,一种无需训练的具身技能自演化框架,通过技能感知反思与定向修正实现优化。该框架结合技能变更证据更新技能内容,利用执行疏漏证据保留并强化有效指引。在ALFWorld和EmbodiedBench上的实验表明,EmbodiSkill显著提升任务成功率。在ALFWorld上,冻结的Qwen3.5-27B执行器达到93.28%的任务成功率,优于未使用技能的GPT-5.2直接代理31.58个百分点。结果证明,技能感知自演化有助于具身智能体从自身轨迹中积累可复用的过程知识。
原文摘要 · Abstract (English)
Embodied agents can benefit from skills that guide object search, action execution, and state changes across diverse environments. Since embodied environments vary across layouts, object states, and other execution factors, these skills must self-evolve from trajectories generated during task execution. However, existing skill self-evolution methods are mainly developed in digital environments and often convert trajectories into coarse skill updates. Directly applying this paradigm to embodied settings is problematic, because a failed task execution may reflect not only incorrect skill content, but also an execution lapse in which the agent fails to follow valid guidance. We propose EmbodiSkill, a training-free framework for embodied skill self-evolution through skill-aware reflection and targeted revision. EmbodiSkill interprets each trajectory with respect to the current skill, uses skill-changing evidence to update the skill body, and uses execution-lapse evidence to preserve and emphasize valid guidance. Experiments on ALFWorld and EmbodiedBench show that EmbodiSkill consistently improves embodied task success. On ALFWorld, EmbodiSkill enables a frozen Qwen3.5-27B executor to reach 93.28% task success, outperforming GPT-5.2 used as a direct agent without skills by 31.58%. These results show that skill-aware self-evolution helps embodied agents accumulate reusable procedural knowledge from their own trajectories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。