arXiv:2512.17853cs.ROcs.AI2025-12被引 10

用AI自动生成机器人任务与数据,提升仿真到现实的迁移效果。

AnyTask: an Automated Task and Data Generation Framework for Advancing Sim-to-Real Policy Learning

  • 通过三个智能体自动设计任务并生成专家示范数据。
  • 在真实机器人上实现44%平均成功率,涵盖多种复杂操作。
  • 适合研究仿真训练、机器人学习和自动化数据生成的团队。

通用机器人学习仍受限于数据:大规模、多样化且高质量的真实交互数据收集成本高昂。尽管仿真成为扩展数据采集的可行途径,但仿真任务设计、任务感知场景生成、专家示范合成及仿真到现实的迁移仍需大量人工投入。我们提出AnyTask,一个将大规模并行GPU仿真与基础模型结合的自动化框架,用于生成多样化的操作任务并合成机器人数据。引入三个AnyTask智能体以生成尽可能多任务的专家示范:1) ViPR,一种基于视觉语言模型闭环反馈的并行优化任务与运动规划智能体;2) ViPR-Eureka,一种利用生成密集奖励与大语言模型引导接触采样的强化学习智能体;3) ViPR-RL,一种联合生成高质量示范的混合规划与学习方法,仅依赖稀疏奖励。我们在生成数据上训练行为克隆策略,经仿真验证后直接部署于真实机器人。策略泛化至新物体姿态,在一组包含抓取放置、抽屉开启、高接触力推动及长时程操作的任务中取得44%平均成功。项目主页见https://anytask.rai-inst.com。

原文摘要 · Abstract (English)

Generalist robot learning remains constrained by data: large-scale, diverse, and high-quality interaction data are expensive to collect in the real world. While simulation has become a promising way for scaling up data collection, the related tasks, including simulation task design, task-aware scene generation, expert demonstration synthesis, and sim-to-real transfer, still demand substantial human effort. We present AnyTask, an automated framework that pairs massively parallel GPU simulation with foundation models to design diverse manipulation tasks and synthesize robot data. We introduce three AnyTask agents for generating expert demonstrations aiming to solve as many tasks as possible: 1) ViPR, a novel task and motion planning agent with VLM-in-the-loop Parallel Refinement; 2) ViPR-Eureka, a reinforcement learning agent with generated dense rewards and LLM-guided contact sampling; 3) ViPR-RL, a hybrid planning and learning approach that jointly produces high-quality demonstrations with only sparse rewards. We train behavior cloning policies on generated data, validate them in simulation, and deploy them directly on real robot hardware. The policies generalize to novel object poses, achieving 44% average success across a suite of real-world pick-and-place, drawer opening, contact-rich pushing, and long-horizon manipulation tasks. Our project website is at https://anytask.rai-inst.com .

机器人学习仿真训练自动化数据AI生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。