用人类协作扰动提升机器人示范数据效率,20%数据胜过传统全量数据。
Adversarial Data Collection: Human-Collaborative Perturbations for Efficient and Robust Robotic Imitation Learning
- 人类实时动态干扰环境与指令,机器人自适应应对,压缩多样失败恢复行为。
- 仅用20%示范数据即实现超越传统方法的组合泛化与抗干扰能力。
- 适合追求高效、鲁棒机器人学习的研究者与工程团队。
为降低真实世界数据收集成本,提升数据效率(质量优于数量)已成为机器人操作的关键。本文提出对抗式数据采集(Adversarial Data Collection, ADC),一种人机协同的闭环框架,通过实时双向互动重构数据获取方式。不同于被动记录静态示范,ADC采用协作扰动范式:在单次演示中,对抗操作员动态改变物体状态、环境条件与语言指令,而远程操作员则自适应调整动作以应对持续变化的挑战。该过程将多样化的失败-恢复行为、组合任务变化及环境扰动压缩至极少量示范中。实验表明,经ADC训练的模型在未见任务指令下具备优异的组合泛化能力,对感知扰动更具鲁棒性,并涌现出错误恢复能力。令人惊讶的是,仅使用传统方法20%的示范数据量,其性能即显著超越后者。本研究揭示了战略性数据采集远比事后处理更关键,推动数据驱动学习向实际部署落地。此外,我们正构建大规模的ADC-Robotics数据集,涵盖带对抗扰动的真实操作任务,后续将开源以促进机器人模仿学习发展。
原文摘要 · Abstract (English)
The pursuit of data efficiency, where quality outweighs quantity, has emerged as a cornerstone in robotic manipulation, especially given the high costs associated with real-world data collection. We propose that maximizing the informational density of individual demonstrations can dramatically reduce reliance on large-scale datasets while improving task performance. To this end, we introduce Adversarial Data Collection, a Human-in-the-Loop (HiL) framework that redefines robotic data acquisition through real-time, bidirectional human-environment interactions. Unlike conventional pipelines that passively record static demonstrations, ADC adopts a collaborative perturbation paradigm: during a single episode, an adversarial operator dynamically alters object states, environmental conditions, and linguistic commands, while the tele-operator adaptively adjusts actions to overcome these evolving challenges. This process compresses diverse failure-recovery behaviors, compositional task variations, and environmental perturbations into minimal demonstrations. Our experiments demonstrate that ADC-trained models achieve superior compositional generalization to unseen task instructions, enhanced robustness to perceptual perturbations, and emergent error recovery capabilities. Strikingly, models trained with merely 20% of the demonstration volume collected through ADC significantly outperform traditional approaches using full datasets. These advances bridge the gap between data-centric learning paradigms and practical robotic deployment, demonstrating that strategic data acquisition, not merely post-hoc processing, is critical for scalable, real-world robot learning. Additionally, we are curating a large-scale ADC-Robotics dataset comprising real-world manipulation tasks with adversarial perturbations. This benchmark will be open-sourced to facilitate advancements in robotic imitation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。