arXiv:2603.24021cs.RO2026-03被引 1

首个支持文本驱动的四足动物动作生成与控制的大规模数据集。

QuadFM: Foundational Text-Driven Quadruped Motion Dataset for Generation and Control

  • 构建包含1.18万段动作的高保真数据集,覆盖多种行为与语言指令。
  • 实现端到端实时运动合成,延迟低于500毫秒,可在边缘设备运行。
  • 适合研究人机交互、智能机器人动作生成与控制的学者和工程师。

尽管四足机器人技术取得显著进展,但缺乏整合多样运动、情感表达与丰富语言语义的基础性运动资源,制约了敏捷、直观的人机交互。现有数据集仅涵盖少量动捕基础动作(如走、跑、坐),且缺乏语言语义丰富的多样化行为。为此,我们提出四足基础运动数据集QuadFM,是首个大规模、超高保真度的文本驱动动作生成与通用运动控制数据集。该数据集包含11,784个精心筛选的动作片段,涵盖运动、交互及情绪表达行为(如跳舞、伸展、排泄),每段动作配备三层标注:细粒度动作标签、交互场景与自然语言指令,总计35,352条描述,支持语言条件下的理解与指令执行。我们进一步提出Gen2Control RL统一框架,联合训练通用运动控制器与文本到动作生成器,实现高效端到端推理。在搭载NVIDIA Orin的实机四足机器人上,系统实现低于500毫秒的实时运动合成。仿真与真实世界结果均表明,生成动作具高度真实性与多样性,同时保持物理交互鲁棒性。数据集将公开于https://github.com/GaoLii/QuadFM。

原文摘要 · Abstract (English)

Despite significant advances in quadrupedal robotics, a critical gap persists in foundational motion resources that holistically integrate diverse locomotion, emotionally expressive behaviors, and rich language semantics-essential for agile, intuitive human-robot interaction. Current quadruped motion datasets are limited to a few mocap primitives (e.g., walk, trot, sit) and lack diverse behaviors with rich language grounding. To bridge this gap, we introduce Quadruped Foundational Motion (QuadFM) , the first large-scale, ultra-high-fidelity dataset designed for text-to-motion generation and general motion control. QuadFM contains 11,784 curated motion clips spanning locomotion, interactive, and emotion-expressive behaviors (e.g., dancing, stretching, peeing), each with three-layer annotation-fine-grained action labels, interaction scenarios, and natural language commands-totaling 35,352 descriptions to support language-conditioned understanding and command execution. We further propose Gen2Control RL, a unified framework that jointly trains a general motion controller and a text-to-motion generator, enabling efficient end-to-end inference on edge hardware. On a real quadruped robot with an NVIDIA Orin, our system achieves real-time motion synthesis (<500 ms latency). Simulation and real-world results show realistic, diverse motions while maintaining robust physical interaction. The dataset will be released at https://github.com/GaoLii/QuadFM.

四足机器人动作生成文本驱动数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。