arXiv:2605.07560cs.RO2026-05

利用失败数据提升机器人模仿学习稳定性

How to Utilize Failure Demo Data?: Effective Data Selection for Imitation Learning Using Distribution Differences in Attention Mechanism

论文配图:How to Utilize Failure Demo Data?: Effective Data Selection for Imitation Learning Using Distribution Differences in Attention Mechanism
图 1 · 摘自论文原文
  • 通过注意力机制捕捉成功与失败数据的差异特征
  • 结合后训练度量筛选有益失败样本,提升任务成功率
  • 无需额外迭代,直接在采集阶段高效利用失败数据

机器人模仿学习通常仅使用成功示范数据,但人类数据收集过程中失败不可避免。现有方法多需额外数据处理或自主滚动更新策略,难以直接稳定利用采集期间积累的失败数据。本文提出一种方法,学习成功与失败之间的潜在表征差异,并将其融入注意力机制。推理时,从初始观测中选择合适的潜在模式以提升动作稳定性。此外,引入后训练度量,量化每个失败样本与成功示范间的注意力差异,用于筛选有益的失败数据。仿真结果表明,该方法在使用失败数据训练时可提高任务成功率,且该度量能有效识别对学习有帮助的失败样本。结果表明,该方法可支持更高效的机器人示范数据采集流程。

原文摘要 · Abstract (English)

Imitation learning for robotic tasks has relied primarily on policies trained only on successful demonstrations, although failures are unavoidable during human data collection. Many existing approaches for exploiting failure data require additional data processing or iterative policy updates through autonomous rollouts, making it difficult to directly and stably utilize failure data accumulated during data collection. In this work, we propose a method that learns latent representations of success-failure discrepancies and incorporates them into the attention mechanism. During inference, an appropriate latent mode is selected from the initial observation to improve action stability. Furthermore, we introduce a post-training metric that quantifies the attention discrepancy between each failure sample and successful demonstrations to select failure data. Simulation results show that the proposed method improves task success rates when trained with failure data and that the proposed metric identifies failure samples that are beneficial for learning when combined with successful demonstrations. These results suggest that the proposed method can support more efficient use of collected demonstrations in robotic data collection pipelines.

模仿学习失败数据注意力机制机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。