arXiv:2607.21648cs.RO2026-07中稿 · the 2026 IEEE/ASME…

用AI生成多样人体动作视频,让机器人学会多种完成任务的方式。

Learning Diverse Humanoid Tasks via Synthetic Video Scenarios without Real World Data

论文配图:Learning Diverse Humanoid Tasks via Synthetic Video Scenarios without Real World Data
图 1 · 摘自论文原文
  • 用文本生成多样化人体动作序列,替代真实数据采集。
  • 在4个仿真场景中成功完成任务,适应复杂动作变化。
  • 适合需要多风格运动技能的机器人训练场景。

类人机器人因其类似人类的形态,具备卓越的敏捷与多功能运动潜力,但复杂技能的学习面临巨大挑战。传统示范学习受限于真实数据收集成本高、动作特异性捕捉难、示范多样性不足等问题。此外,同一任务人类可能采用多种不同执行方式。本文提出新框架,利用生成式AI将文本提示转化为逼真且多样的人体运动序列,使机器人能观察同一任务的多种执行方式。这些合成示范作为训练资源,使机器人无需人工干预即可学习广泛的任务执行风格。我们在四个仿真场景中评估该方法,实验结果表明机器人不仅能成功完成任务,还展现出对复杂运动变化的强适应能力。

原文摘要 · Abstract (English)

The human-like morphology of humanoid robots grants them exceptional potential for agile and versatile motor capabilities, but it also introduces significant challenges in acquiring complex skills. Traditional Learning-from-Demonstrations methods are often constrained by the high cost of collecting real-world data, the difficulty of capturing motion-specific behaviors, and the limited diversity of demonstrations across individuals. Moreover, even for the same task, humans may execute the motion in multiple distinct ways. In this paper, we propose a new framework that leverages the power of Generative AI to convert textual prompts into realistic and diverse sequences of human body movements, enabling the robot to observe multiple variations of how a single task can be performed. These synthetic demonstrations are then used as a training resource, allowing the robot to learn a broad range of task-execution styles without requiring direct human intervention. We evaluate the proposed method across four simulation scenarios. Experimental results show that the robot not only completes the tasks successfully but also demonstrates strong adaptability to complex variations in motion.

机器人学习生成模型动作合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。