arXiv:2506.23944cs.ROcs.AI2025-06

让机器人模仿学习更稳,解决感知数据在训练和实际中不一致的问题。

Adapt Your Body: Mitigating Proprioception Shifts in Imitation Learning

  • 用部署时收集的数据,通过距离度量来对齐训练与实际的感知分布。
  • 实验显示新方法在机械臂任务中表现优于丢弃感知或传统对齐方法。
  • 适合做机器人操控、需高精度身体感知的模仿学习研究者参考。

用于机器人任务的模仿学习模型通常依赖多模态输入,如RGB图像、语言指令和本体感受状态。尽管本体感受对决策和避障至关重要,但直接使用所有本体感受状态反而导致模仿学习性能下降。本文识别出根本问题是本体感受分布偏移——训练与部署时的本体感受状态分布差异显著。为此,我们提出一种域适应框架,利用部署阶段收集的轨迹数据来弥合差距。通过Wasserstein距离量化专家与部署轨迹的本体感受状态差异,并按该距离比例向两组状态添加噪声,从而缩小分布差距。该策略增强了对本体感受偏移的鲁棒性,使训练与部署分布对齐。在机器人抓取任务上的实验表明,该方法有效利用了本体感受,同时缓解其负面影响,性能超越简单丢弃本体感受的方法及其他应对分布偏移的基线。

原文摘要 · Abstract (English)

Imitation learning models for robotic tasks typically rely on multi-modal inputs, such as RGB images, language, and proprioceptive states. While proprioception is intuitively important for decision-making and obstacle avoidance, simply incorporating all proprioceptive states leads to a surprising degradation in imitation learning performance. In this work, we identify the underlying issue as the proprioception shift problem, where the distributions of proprioceptive states diverge significantly between training and deployment. To address this challenge, we propose a domain adaptation framework that bridges the gap by utilizing rollout data collected during deployment. Using Wasserstein distance, we quantify the discrepancy between expert and rollout proprioceptive states and minimize this gap by adding noise to both sets of states, proportional to the Wasserstein distance. This strategy enhances robustness against proprioception shifts by aligning the training and deployment distributions. Experiments on robotic manipulation tasks demonstrate the efficacy of our method, enabling the imitation policy to leverage proprioception while mitigating its adverse effects. Our approach outperforms the naive solution which discards proprioception, and other baselines designed to address distributional shifts.

模仿学习机器人域适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。