arXiv:2506.00043cs.ROcs.CV2025-06

用大模型生成行为计划,驱动更自然的长时序人类动作模拟。

From Motion to Behavior: Hierarchical Modeling of Humanoid Generative Behavior Control

  • 基于大模型生成分层行为计划,统一控制高阶意图与低阶动作。
  • 在自建数据集上实现10倍于现有方法的生成时长与动作多样性。
  • 适合研究具身智能、人形机器人行为建模的开发者和研究人员。

人类运动生成旨在刻画日常活动中复杂多样的动作行为。然而,当前研究主要聚焦于低层次短时动作或高层次动作规划,忽略了人类活动的分层目标导向特性。本文提出统一框架Generative Behavior Control(GBC),从动作生成迈向行为建模,受认知科学启发,通过将大语言模型生成的分层行为计划与运动轨迹对齐,驱动多样化人类动作。核心思想是:在机器人任务与动作规划基础上,由大模型引导以提升动作多样性和物理合理性。为克服现有基准缺乏行为计划的局限,我们构建了包含10万条样本的GBC-100K数据集,标注了语义与运动计划的分层结构。实验表明,在该数据集上训练的GBC可生成更高质量、目的明确且时长达现有方法10倍的人类动作序列,为后续行为建模研究奠定基础。数据集与代码将公开发布。

原文摘要 · Abstract (English)

Human motion generative modeling or synthesis aims to characterize complicated human motions of daily activities in diverse real-world environments. However, current research predominantly focuses on either low-level, short-period motions or high-level action planning, without taking into account the hierarchical goal-oriented nature of human activities. In this work, we take a step forward from human motion generation to human behavior modeling, which is inspired by cognitive science. We present a unified framework, dubbed Generative Behavior Control (GBC), to model diverse human motions driven by various high-level intentions by aligning motions with hierarchical behavior plans generated by large language models (LLMs). Our insight is that human motions can be jointly controlled by task and motion planning in robotics, but guided by LLMs to achieve improved motion diversity and physical fidelity. Meanwhile, to overcome the limitations of existing benchmarks, i.e., lack of behavioral plans, we propose GBC-100K dataset annotated with a hierarchical granularity of semantic and motion plans driven by target goals. Our experiments demonstrate that GBC can generate more diverse and purposeful high-quality human motions with 10* longer horizons compared with existing methods when trained on GBC-100K, laying a foundation for future research on behavioral modeling of human motions. Our dataset and source code will be made publicly available.

行为建模人形机器人大模型动作生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。