不训练模型,通过优化技能和代码框架实现智能体自进化。
Self-Evolving Embodied Agents via Skill-Harness Evolution

- 用固定模型同时当规划器和优化器,演化可复用技能与上下文代码框架。
- 在多个环境测试中超越纯执行、微调和测试时扩展基线方法。
- 适合无法训练模型或需快速适应新环境的场景,如固定接口机器人。
具身智能体越来越多地基于基础模型构建,其表现不仅取决于模型权重,还依赖于技能、上下文、动作接口及执行框架。尽管监督微调和强化学习能适应新环境,但需额外数据、奖励信号和训练过程;而许多无需训练的代码驱动方法依赖可编程机器人API,难以应用于固定接口场景。本文提出SHAPER,一种无需训练的具身自适应框架,保持模型参数冻结,通过目标环境的回放演化可复用技能与上下文代码框架。在SHAPER中,同一冻结模型可同时充当规划器与优化器,无需参数更新即可改进外部技能与框架。我们在VLABench和ESI-Bench上评估该方法,涵盖不同底层动作接口的具身智能体,并与纯执行、监督微调及测试时扩展基线(如无验证器选择、投票)进行对比。结果表明,在模型训练成本高、不可用或不希望训练时,技能与框架优化是实现自进化具身智能体的可行路径。
原文摘要 · Abstract (English)
Embodied agents are increasingly built as systems around foundation models, where performance depends not only on model weights but also on the skills, context, action interfaces, and execution harness surrounding the model. While supervised fine-tuning and reinforcement learning can adapt agents to new environments, they require additional data, rewards, and training runs; meanwhile, many train-free code-centric approaches rely on programmable robot APIs that may be unavailable in fixed-interface settings. We propose SHAPER, a self-evolving framework for train-free embodied adaptation that keeps model parameters frozen and improves the non-parametric agent system by evolving reusable skills and a context-code harness through target-environment rollouts. In SHAPER, the same frozen model can serve as both planner and optimizer, refining its external skills and context-code harness without parameter updates. We evaluate SHAPER on VLABench and ESI-Bench, covering embodied agents with different low-level action interfaces, and compare against pure execution, supervised fine-tuning, and test-time-scaling baselines such as verifier-free selection and voting. Our results suggest that skill-and-harness optimization is a practical route to self-evolving embodied agents when model training is expensive, unavailable, or undesirable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。