arXiv:2502.16372cs.RO2025-02被引 9

用一套策略让不同机器人通用移动,只需一个机器人的示范数据。

COMPASS: Cross-embodiment Mobility Policy via Residual RL and Skill Synthesis

  • 先用一个机器人示范数据训练基础策略,再通过残差强化学习适配其他机器人。
  • 在未见过的机器人上成功率提升5倍,且直接从仿真迁移到真实环境。
  • 适合需要快速部署多种机器人、不想每种都单独调教的场景。

随着机器人在多样应用场景中普及,实现跨平台稳健移动成为关键挑战。传统移动系统虽在特定平台上有效,但需大量针对每种机器人的调参,难以扩展。基于学习的方法如模仿学习(IL)虽可替代,但依赖高质量示范数据,且需为每种机器人收集。为此,我们提出COMPASS,一种统一框架,仅需单一机器人的专家示范即可实现跨平台移动的可扩展性。首先在单个机器人上使用模仿学习预训练移动策略,结合世界模型与策略模型;随后采用残差强化学习(RL),通过修正性微调高效适应多种机器人;最后将专用策略蒸馏为一个条件于机器人嵌入向量的通用策略。该设计显著降低数据采集负担,同时实现广泛机器人设计下的鲁棒泛化。实验表明,COMPASS在多种机器人平台上有效扩展,对不同环境配置保持适应性,在未见机器人上的成功率达预训练IL策略的5倍,并实现零样本仿真到现实迁移。

原文摘要 · Abstract (English)

As robots are increasingly deployed in diverse application domains, enabling robust mobility across different embodiments has become a critical challenge. Classical mobility stacks, though effective on specific platforms, require extensive per-robot tuning and do not scale easily to new embodiments. Learning-based approaches, such as imitation learning (IL), offer alternatives, but face significant limitations on the need for high-quality demonstrations for each embodiment. To address these challenges, we introduce COMPASS, a unified framework that enables scalable cross-embodiment mobility using expert demonstrations from only a single embodiment. We first pre-train a mobility policy on a single robot using IL, combining a world model with a policy model. We then apply residual reinforcement learning (RL) to efficiently adapt this policy to diverse embodiments through corrective refinements. Finally, we distill specialist policies into a single generalist policy conditioned on an embodiment embedding vector. This design significantly reduces the burden of collecting data while enabling robust generalization across a wide range of robot designs. Our experiments demonstrate that COMPASS scales effectively across diverse robot platforms while maintaining adaptability to various environment configurations, achieving a generalist policy with a success rate approximately 5X higher than the pre-trained IL policy on unseen embodiments, and further demonstrates zero-shot sim-to-real transfer.

移动策略跨平台模仿学习强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。