arXiv:2506.05952cs.CVcs.AI2025-06被引 3

提出MOGO框架,实现高质量3D人体动作实时生成

MOGO: Residual Quantized Hierarchical Causal Transformer for High-Quality and Real-Time 3D Human Motion Generation

  • 采用分层残差向量量化与因果变换器,单次前向传播生成动作
  • 在HumanML3D等数据集上达到顶尖生成质量,推理延迟显著降低
  • 适合需要低延迟、可流式传输的动作生成场景

基于Transformer的文本到动作生成近期取得显著进展,但同时实现高保真度、流式能力、实时响应和可扩展性仍是核心挑战。本文提出MOGO(Motion Generation with One-pass),一种专为高效实时3D动作生成设计的自回归框架。MOGO包含两个关键组件:(1) MoSA-VQ,一种运动尺度自适应的残差向量量化模块,通过可学习缩放实现运动序列的分层离散化,生成紧凑而丰富的表示;(2) RQHC-Transformer,一种残差量化分层因果变换器,可在单次前向传播中生成多层动作标记,大幅降低推理延迟。为提升语义保真度,还引入文本条件对齐机制,增强文本控制下的动作解码效果。在HumanML3D、KIT-ML和CMP等基准数据集上的大量实验表明,MOGO在生成质量上达到或超越现有先进Transformer方法,同时在实时性能、流式生成及零样本泛化方面有显著提升。

原文摘要 · Abstract (English)

Recent advances in transformer-based text-to-motion generation have led to impressive progress in synthesizing high-quality human motion. Nevertheless, jointly achieving high fidelity, streaming capability, real-time responsiveness, and scalability remains a fundamental challenge. In this paper, we propose MOGO (Motion Generation with One-pass), a novel autoregressive framework tailored for efficient and real-time 3D motion generation. MOGO comprises two key components: (1) MoSA-VQ, a motion scale-adaptive residual vector quantization module that hierarchically discretizes motion sequences with learnable scaling to produce compact yet expressive representations; and (2) RQHC-Transformer, a residual quantized hierarchical causal transformer that generates multi-layer motion tokens in a single forward pass, significantly reducing inference latency. To enhance semantic fidelity, we further introduce a text condition alignment mechanism that improves motion decoding under textual control. Extensive experiments on benchmark datasets including HumanML3D, KIT-ML, and CMP demonstrate that MOGO achieves competitive or superior generation quality compared to state-of-the-art transformer-based methods, while offering substantial improvements in real-time performance, streaming generation, and generalization under zero-shot settings.

动作生成Transformer实时生成向量量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。