用吸引力场生成多样高质机器人操作数据,大幅减少人工成本
FieldGen: From Teleoperated Pre-Manipulation Trajectories to Field-Guided Data Generation
- 将操作分为预轨迹与精调两阶段,利用吸引力场自动生成多样化轨迹
- 在真实场景中训练的策略成功率更高,且比人工示范节省大量人力
- 适合需要大规模高质量数据的机器人学习研究者,尤其关注效率提升
大规模且多样化的数据集对训练鲁棒的机器人操作策略至关重要,但现有数据采集方法难以兼顾规模、多样性和质量。仿真虽具可扩展性,却存在模拟到现实的差距;遥操作能提供高质量示范,但多样性有限且人力成本高。我们提出 FieldGen,一种基于吸引力场的实时数据生成框架,实现低人工干预下的大规模、多样化、高质量真实世界数据收集。FieldGen 将操作分解为预操作阶段(允许轨迹多样性)和精细操作阶段(需专家精度)。人类示范捕捉关键接触与姿态信息后,吸引力场自动生成收敛至成功配置的多样化轨迹。该解耦设计结合了轨迹多样性与精准监督。此外,FieldGen-Reward 还为生成数据添加奖励标注,进一步提升策略学习效果。实验表明,使用 FieldGen 训练的策略在成功率和稳定性上均优于基于遥操作的基线方法,同时显著降低长期真实世界数据收集中的人力投入。
原文摘要 · Abstract (English)
Large-scale and diverse datasets are vital for training robust robotic manipulation policies, yet existing data collection methods struggle to balance scale, diversity, and quality. Simulation offers scalability but suffers from sim-to-real gaps, while teleoperation yields high-quality demonstrations with limited diversity and high labor cost. We introduce FieldGen, a field-guided data generation framework that enables scalable, diverse, and high-quality real-world data collection with minimal human supervision. FieldGen decomposes manipulation into two stages: a pre-manipulation phase, allowing trajectory diversity, and a fine manipulation phase requiring expert precision. Human demonstrations capture key contact and pose information, after which an attraction field automatically generates diverse trajectories converging to successful configurations. This decoupled design combines scalable trajectory diversity with precise supervision. Moreover, FieldGen-Reward augments generated data with reward annotations to further enhance policy learning. Experiments demonstrate that policies trained with FieldGen achieve higher success rates and improved stability compared to teleoperation-based baselines, while significantly reducing human effort in long-term real-world data collection. Webpage is available at https://fieldgen.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。