arXiv:2606.28237cs.RO2026-06被引 1

用AI生成四足机器人动作,无需实拍数据即可实现丰富拟人行为。

Unleashing Infinite Motion: Scaling Expressive Quadrupedal Motion via Generative Video Priors

论文配图:Unleashing Infinite Motion: Scaling Expressive Quadrupedal Motion via Generative Video Priors
图 1 · 摘自论文原文
  • 通过语言模型+视频扩散模型自动生成四足机器人动作视频。
  • 在真实机器人上成功部署392个动作,成功率96.7%。
  • 适合对机器人行为多样性感兴趣的开发者与研究者。

四足机器人虽已实现优异行走能力,但其行为模式仍局限于少数步态,远未达到预期的生动陪伴效果。传统方法依赖动物实拍数据,受限于动物配合、跨物种重建困难及形态不兼容导致的动作迁移问题。本文提出Uni-Mo全自动流程:语言大模型生成动作提示,视频扩散模型合成对应机器人行为,生成视频转为3D轨迹训练跟踪策略,并部署于真实Unitree Go2机器人。为解决生成结果漂移问题,引入身份一致性损失以保持帧间外观一致。发布开源数据集Quad-Imaginarium(https://github.com/GaoLii/Quad-Imaginarium.git),包含7,488条带语言标注的四足动作(18.5小时),涵盖杂技与表演类行为。在真实机器人上随机验证392个动作,部署成功率达96.7%;全数据集模拟测试成功率97.6%。

原文摘要 · Abstract (English)

Quadruped robots have achieved remarkable locomotion, yet their behavioral repertoire remains confined to a few gaits--far from the expressive, companion-like presence long envisioned for them. Attempts to import the humanoid recipe of large-scale motion data have inherited one tacit assumption: that robot motion must first pass through an animal body, making data collection dependent on cooperative animals, reconstruction fragile across species, and retargeting ill-posed across incompatible morphologies. We propose Uni-Mo, a fully automated pipeline that removes the animal from the loop by reframing data scarcity as a generation problem: an LLM proposes motion prompts, a video diffusion model synthesizes the corresponding robot behaviors, and the generated videos are lifted into 3D reference trajectories used to train tracking policies deployed on a real Unitree Go2. To make naively-drifting generations reliably extractable, we introduce an Identity Consistency Loss that enforces appearance coherence across frames. We release Quad-Imaginarium at https://github.com/GaoLii/Quad-Imaginarium.git, the resulting open-source dataset of 7,488 language-annotated quadruped motions (18.5 hours) spanning acrobatic and performative behaviors. We validate 392 randomly sampled motions on a real Unitree Go2 with a 96.7% deployment success rate, complemented by a 97.6% success rate across the full dataset in simulation.

四足机器人动作生成视频扩散智能控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。