用9种机器人增强数据集,让机械臂策略更通用且适应新硬件。
OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learning
- 通过自动化工具链扩增原数据集,加入9种不同机械臂和夹爪组合。
- 新数据集超440万条轨迹,性能测试显示在未见设备上成功率提升24%-45%。
- 适合做通用机器人策略训练的研究者和开发者使用。
训练能控制多种机器人形态(如机械臂与夹爪组合)的通用策略,需要大规模多样化的数据集。现有数据集如Open X-Embodiment(OXE)虽聚合了60多个来源的演示数据,但高度不平衡——前四种机器人类型占其真实数据的85%以上,易导致对特定组合过拟合。本文提出AugE-Toolkit可扩展的机器人数据增强管道,并构建了高质量开源数据集OXE-AugE,将原始数据增加至9种机器人形态。该数据集包含超过440万条轨迹,规模超过原OXE的三倍。系统研究表明,通过多样化机器人形态增强数据,不仅提升了在新增机器人上的策略表现,也增强了对未见机器人及原机器人在分布偏移下的泛化能力。物理实验验证,基于OXE-AugE微调OpenVLA和$π_0$等前沿通用策略,在四个真实操作任务中对未见过的机械臂-夹爪组合成功率提升24%-45%。
原文摘要 · Abstract (English)
Large and diverse datasets are needed for training generalist robot policies that have potential to control a variety of robot embodiments -- robot arm and gripper combinations -- across diverse tasks and environments. As re-collecting demonstrations and retraining for each new hardware platform are prohibitively costly, we show that existing robot data can be augmented for transfer and generalization. The Open X-Embodiment (OXE) dataset, which aggregates demonstrations from over 60 robot datasets, has been widely used as the foundation for training generalist policies. However, it is highly imbalanced: the top four robot types account for over 85\% of its real data, which risks overfitting to robot-scene combinations. We present AugE-Toolkit, a scalable robot augmentation pipeline, and OXE-AugE, a high-quality open-source dataset that augments OXE with 9 different robot embodiments. OXE-AugE provides over 4.4 million trajectories, more than triple the size of the original OXE. We conduct a systematic study of how scaling robot augmentation impacts cross-embodiment learning. Results suggest that augmenting datasets with diverse arms and grippers improves policy performance not only on the augmented robots, but also on unseen robots and even the original robots under distribution shifts. In physical experiments, we demonstrate that state-of-the-art generalist policies such as OpenVLA and $π_0$ benefit from fine-tuning on OXE-AugE, improving success rates by 24-45% on previously unseen robot-gripper combinations across four real-world manipulation tasks. Project website: https://OXE-AugE.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。