用合成数据训练机器人,实测通用抓取能力。
RoboSynChallenge: Mastering Real-World Dexterity via Generalizing Synthesized Manipulation Skills

- 用大规模合成数据训练抓取策略,提升泛化能力。
- 在未见过的真实环境上测试,验证实际表现。
- 适合研究机器人泛化与数据效率的学者。
实现可泛化的机器人操作仍是具身智能的核心挑战。尽管模型架构和学习算法迅速发展,进展常受限于真实世界数据的稀缺性和多样性不足。RoboSynChallenge竞赛引入统一基准,评估并推动操作策略在多种任务、环境和难度下的泛化性能。为缓解真实数据短缺,挑战结合大规模合成数据生成与标准化真实机器人评估。参赛者可利用合成的状态-动作数据改进通用策略学习,最终评估仅在未见过的真实操作环境中进行。提供基于Transformer、扩散模型、视觉-语言-动作及世界-动作模型的基线实现,确保可复现性与可比性。通过融合可扩展的仿真训练与严格的现实验证,RoboSynChallenge旨在促进数据高效、适应性强的通用操作系统的研发,为真正通用的机器人智能铺平道路。
原文摘要 · Abstract (English)
Achieving generalizable robotic manipulation remains a central challenge in embodied intelligence. Despite rapid advances in model architectures and learning algorithms, progress is often limited by the scarcity and narrow diversity of real-world data. The RoboSynChallenge competition introduces a unified benchmark to evaluate and advance the generalizability of manipulation policies across a spectrum of tasks, environments, and difficulty levels. To alleviate the shortage of realistic data, the challenge integrates large-scale synthetic data generation with standardized real-world robotic evaluation. Participants are encouraged to leverage synthesized state-action trials to improve general-purpose policy learning, while final assessments are conducted exclusively on unseen real-world manipulation environments. Baseline implementations, including Transformer-, Diffusion-, Vision-Language-Action, and World-Action-Model-based policies, are provided to ensure reproducibility and comparability. By coupling scalable simulation-based training with rigorous real-world validation, RoboSynChallenge aims to foster the development of broadly capable, data-efficient, and adaptable manipulation systems, thereby paving the way toward truly general robotic intelligence.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。