用统一动作空间让不同来源数据协同模仿,提升机器人学习泛化能力。
Imitation from Heterogeneous Demonstrations using Grounded Latent-Action World Models

- 构建共享潜动作空间的生成模型,通过预测未来观测来对齐异源数据
- 在五个仿真与真实任务中,成功率平均提升48%,超越基线方法
- 适用于无动作标签的数据,适合数据稀缺场景下的机器人学习
模仿学习虽是学习视觉-运动策略的强大范式,但其泛化性与稳定性受限于演示数据的规模与质量。一个有前景的方向是利用更丰富但异构的数据源,这些数据在动作空间上存在差异,且常缺乏动作标签。现有联合训练方法依赖启发式和人工设计的对齐技术。本文认为,动作表征应基于预测:对环境产生相同影响的动作应共享同一表示,无论其来源如何。为此,提出接地潜动作世界模型(GLAM),即一对具有跨数据源共享潜动作空间的生成模型,该空间通过在不同数据源间一致预测未来观测而实现接地。该潜动作空间用于训练下游行为克隆(BC)策略,将观测映射到潜动作并解码为机器人动作,形成从异源数据学习的新范式。实验表明,GLAM成功学习到对齐的潜动作空间,实现了跨数据源的动作迁移,包括无标签数据。在五个模拟与真实世界操作任务中,使用相同数据稀缺设置,其策略平均成功率提升48%,显著优于基线和已有潜动作方法。视频与代码见https://viccccciv.github.io/glam/
原文摘要 · Abstract (English)
Imitation learning has emerged as a powerful paradigm for learning visuomotor policies, but its generalisation and stability are limited by the scale and quality of demonstration data needed. A promising direction is to leverage more abundant but heterogeneous data sources, which differ in action space and often lack action labels altogether. Existing co-training approaches that combine heterogeneous data sources rely on heuristic and hand-engineered alignment techniques. In contrast, we argue that action representations should be grounded in prediction: actions that produce the same effect on the environment should share the same representation, regardless of their sources. To this end, we instantiate this principle by using a grounded latent-action world model (GLAM), a pair of generative models with a shared latent action space across data sources that is grounded by predicting future observations consistently across sources. This latent action space is used to train downstream behavioural cloning (BC) policies which map observations to latent actions and decode them back to robot actions, providing a paradigm for learning from heterogeneous data. Empirically, we demonstrate that GLAM successfully learns an aligned latent action space that facilitates action transfer across data sources with and without action labels. Across five manipulation tasks in simulation and in the real world, GLAM-aligned policies significantly outperform BC baselines and prior latent-action methods, achieving an average of +48% improvement in task success rate with the same data-scarce setting. Videos and code are available at https://viccccciv.github.io/glam/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。