arXiv:2602.08462cs.CV2026-02

通过三域因果建模,实现文本到动作生成的高保真与一致性。

TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generation

  • 融合时空频三域建模,用扩散模型统一优化
  • 在HumanML3D上达0.612的R@1,优于现有方法
  • 因果去噪机制分离无关噪声,适合高精度动作生成

文本到动作生成是计算机视觉中快速发展的领域,旨在生成逼真且与文本对齐的动作序列。当前方法主要关注时空建模或独立的频域分析,缺乏在空间、时间与频域联合优化的统一框架,限制了模型同时利用多域信息的能力,导致生成质量不佳。此外,运动生成中由噪声引起的无关特征常与有效特征纠缠,引发动作失真。为此,本文提出基于扩散模型的三域因果文本到动作生成框架TriC-Motion,包含时序运动编码、空间拓扑建模与混合频域分析三个核心模块。经全面建模后,得分引导的三域融合模块整合各域有价值信息,同时保障时序一致性、空间拓扑结构、运动趋势与动态特性。此外,基于因果的反事实去纠缠模块可有效暴露并消除无关噪声,分离各域的真实贡献,提升生成质量。大量实验表明,TriC-Motion在HumanML3D数据集上取得0.612的R@1,显著优于现有方法,能生成高保真、连贯、多样且与文本对齐的动作序列。代码已公开。

原文摘要 · Abstract (English)

Text-to-motion generation, a rapidly evolving field in computer vision, aims to produce realistic and text-aligned motion sequences. Current methods primarily focus on spatial-temporal modeling or independent frequency domain analysis, lacking a unified framework for joint optimization across spatial, temporal, and frequency domains. This limitation hinders the model's ability to leverage information from all domains simultaneously, leading to suboptimal generation quality. Additionally, in motion generation frameworks, motion-irrelevant cues caused by noise are often entangled with features that contribute positively to generation, thereby leading to motion distortion. To address these issues, we propose Tri-Domain Causal Text-to-Motion Generation (TriC-Motion), a novel diffusion-based framework integrating spatial-temporal-frequency-domain modeling with causal intervention. TriC-Motion includes three core modeling modules for domain-specific modeling, namely Temporal Motion Encoding, Spatial Topology Modeling, and Hybrid Frequency Analysis. After comprehensive modeling, a Score-guided Tri-domain Fusion module integrates valuable information from the triple domains, simultaneously ensuring temporal consistency, spatial topology, motion trends, and dynamics. Moreover, the Causality-based Counterfactual Motion Disentangler is meticulously designed to expose motion-irrelevant cues to eliminate noise, disentangling the real modeling contributions of each domain for superior generation. Extensive experimental results validate that TriC-Motion achieves superior performance compared to state-of-the-art methods, attaining an outstanding R@1 of 0.612 on the HumanML3D dataset. These results demonstrate its capability to generate high-fidelity, coherent, diverse, and text-aligned motion sequences. Code is available at: https://caoyiyang1105.github.io/TriC-Motion/.

动作生成扩散模型因果建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。