arXiv:2509.04058cs.GRcs.CV2025-09被引 5

用大模型生成带风格的动作,让动作更可控、更灵活。

SMooGPT: Stylized Motion Generation using Large Language Models

  • 用身体部位文本空间作为中间表示,实现动作的语义化生成
  • 在纯文本驱动下生成新风格动作,效果优于传统方法
  • 适合需要精细控制和多样风格生成的动画创作场景

风格化动作生成是计算机图形学中的研究热点,尤其受益于扩散模型的快速发展。该任务的目标是生成既符合动作内容又具有指定风格的新动作,例如“像猴子一样绕圈走”。现有方法多通过风格迁移或条件生成,将风格嵌入潜在空间并隐式引导生成。然而这些方法存在可解释性差、控制能力弱、泛化能力有限(仅限于‘走路’类动作)等问题。本文提出从推理-组合-生成的新视角解决该问题,基于三大观察:1)人类动作可用自然语言以身体部位为中心有效描述;2)大语言模型具备理解与推理动作的能力;3)动作具有内在组合性,可通过重构生成新内容或风格。为此,我们引入身体部位文本空间作为中间表示,提出SMooGPT——一个微调的大语言模型,兼具推理、组合与生成功能。该方法在身体部位文本空间中执行,显著提升可解释性,支持细粒度控制,有效缓解动作内容与风格间的冲突,并凭借大语言模型的开放词汇能力实现对新风格的良好泛化。大量实验与用户感知研究验证了其有效性,尤其在纯文本驱动的风格化动作生成中表现突出。

原文摘要 · Abstract (English)

Stylized motion generation is actively studied in computer graphics, especially benefiting from the rapid advances in diffusion models. The goal of this task is to produce a novel motion respecting both the motion content and the desired motion style, e.g., ``walking in a loop like a Monkey''. Existing research attempts to address this problem via motion style transfer or conditional motion generation. They typically embed the motion style into a latent space and guide the motion implicitly in a latent space as well. Despite the progress, their methods suffer from low interpretability and control, limited generalization to new styles, and fail to produce motions other than ``walking'' due to the strong bias in the public stylization dataset. In this paper, we propose to solve the stylized motion generation problem from a new perspective of reasoning-composition-generation, based on our observations: i) human motion can often be effectively described using natural language in a body-part centric manner, ii) LLMs exhibit a strong ability to understand and reason about human motion, and iii) human motion has an inherently compositional nature, facilitating the new motion content or style generation via effective recomposing. We thus propose utilizing body-part text space as an intermediate representation, and present SMooGPT, a fine-tuned LLM, acting as a reasoner, composer, and generator when generating the desired stylized motion. Our method executes in the body-part text space with much higher interpretability, enabling fine-grained motion control, effectively resolving potential conflicts between motion content and style, and generalizes well to new styles thanks to the open-vocabulary ability of LLMs. Comprehensive experiments and evaluations, and a user perceptual study, demonstrate the effectiveness of our approach, especially under the pure text-driven stylized motion generation.

动作生成大模型文本驱动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。