arXiv:2509.19460cs.ROcs.AI2025-09被引 2

用模拟器自动生成示范数据,少样本下也能练出强模型

Self-evolved Imitation Learning in Simulated World

  • 模型在模拟环境里试错,成功轨迹自动变新示范数据
  • 仅用少量初始示范,就达到当前最佳少样本表现
  • 适合研究少样本模仿学习或想降低数据成本的团队

模仿学习近年兴起,但跨任务训练通用智能体仍需大量专家示范,收集成本高。为缓解监督不足问题,本文提出自演化模仿学习(SEIL)框架,通过模拟器交互逐步优化少样本模型。模型先在模拟环境中尝试任务,成功轨迹被收集为新示范用于迭代精炼。为提升示范多样性,SEIL采用双层增强:(i) 模型层面,使用指数移动平均(EMA)模型与主模型协作;(ii) 环境层面,引入初始物体位置微调。进一步设计轻量级选择器,从生成池中筛选互补且信息丰富的轨迹,确保示范质量。经筛选的样本使模型在极低示范数下实现优异性能。在LIBERO基准上的大量实验表明,SEIL在少样本模仿学习场景中达到新最优水平。代码已开源。

原文摘要 · Abstract (English)

Imitation learning has been a trend recently, yet training a generalist agent across multiple tasks still requires large-scale expert demonstrations, which are costly and labor-intensive to collect. To address the challenge of limited supervision, we propose Self-Evolved Imitation Learning (SEIL), a framework that progressively improves a few-shot model through simulator interactions. The model first attempts tasksin the simulator, from which successful trajectories are collected as new demonstrations for iterative refinement. To enhance the diversity of these demonstrations, SEIL employs dual-level augmentation: (i) Model-level, using an Exponential Moving Average (EMA) model to collaborate with the primary model, and (ii) Environment-level, introducing slight variations in initial object positions. We further introduce a lightweight selector that filters complementary and informative trajectories from the generated pool to ensure demonstration quality. These curated samples enable the model to achieve competitive performance with far fewer training examples. Extensive experiments on the LIBERO benchmark show that SEIL achieves a new state-of-the-art performance in few-shot imitation learning scenarios. Code is available at https://github.com/Jasper-aaa/SEIL.git.

模仿学习少样本模拟训练自演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。