10万条真实场景机器人操作数据,提升复杂任务学习效果
FastUMI-100K: Advancing Data-driven Robotic Manipulation with a Large-scale UMI-style Dataset
- 用模块化机械臂+轻量追踪系统自动生成高质量演示数据
- 覆盖54类任务、百余种物体,单条轨迹120-500帧
- 适合做数据驱动机器人操作研究的学者和工程师
数据驱动的机器人操作学习依赖大规模、高质量的专家示范数据集。然而,现有数据集主要依赖人工遥操作采集,存在可扩展性差、轨迹不平滑、在真实环境中跨机器人泛化能力弱等问题。本文提出FastUMI-100K,一个大规模、多模态的UMI风格示范数据集,旨在克服上述局限,满足日益复杂的现实操作任务需求。该数据集由FastUMI系统收集,其采用模块化、硬件解耦的机械结构与集成轻量级追踪系统,具备更强的可扩展性、灵活性与适应性。FastUMI-100K包含超过10万条示范轨迹,覆盖54项代表性家庭环境任务及数百种物体类型,每条轨迹长度为120至500帧。数据集融合末端执行器状态、多视角腕装鱼眼图像及文本注释等多模态信息。实验表明,该数据集可在多种基线算法上实现高成功率,验证了其在复杂动态操作挑战中的鲁棒性、适应性与实际应用价值。源代码与数据集将通过https://github.com/MrKeee/FastUMI-100K发布。
原文摘要 · Abstract (English)
Data-driven robotic manipulation learning depends on large-scale, high-quality expert demonstration datasets. However, existing datasets, which primarily rely on human teleoperated robot collection, are limited in terms of scalability, trajectory smoothness, and applicability across different robotic embodiments in real-world environments. In this paper, we present FastUMI-100K, a large-scale UMI-style multimodal demonstration dataset, designed to overcome these limitations and meet the growing complexity of real-world manipulation tasks. Collected by FastUMI, a novel robotic system featuring a modular, hardware-decoupled mechanical design and an integrated lightweight tracking system, FastUMI-100K offers a more scalable, flexible, and adaptable solution to fulfill the diverse requirements of real-world robot demonstration data. Specifically, FastUMI-100K contains over 100K+ demonstration trajectories collected across representative household environments, covering 54 tasks and hundreds of object types. Our dataset integrates multimodal streams, including end-effector states, multi-view wrist-mounted fisheye images and textual annotations. Each trajectory has a length ranging from 120 to 500 frames. Experimental results demonstrate that FastUMI-100K enables high policy success rates across various baseline algorithms, confirming its robustness, adaptability, and real-world applicability for solving complex, dynamic manipulation challenges. The source code and dataset will be released in this link https://github.com/MrKeee/FastUMI-100K.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。