arXiv:2606.23000cs.CV2026-06中稿 · ICML

从稀疏观测重建人体运动,分步细化细节,精度领先

MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observations

论文配图:MotionMAR: Multi-scale Auto-Regressive Human Motion Reconstruction from Sparse Observations
图 1 · 摘自论文原文
  • 分阶段生成:先建全局轨迹,再逐步补细节
  • 在AMASS上误差比现有方法低12.3%,关键点更准
  • 适合动作捕捉、虚拟人等需要高精度运动还原的场景

人体运动具有从低频全局轨迹到高频细节的时序层次结构。受计算机视觉中多层级自回归模型的启发,我们提出MotionMAR,一种从稀疏观测中进行人体运动重建的粗到精框架。该框架首先估计运动的全局轨迹,再逐步细化时间细节。其包含四个集成组件:时序多尺度标记化(TMT)VQ-VAE在多个时间分辨率下编码数据,分离语义运动与微小抖动;运动自回归网络(MAN)在此潜在空间中预测运动,先通过粗粒度索引建立全局结构,再生成细粒度索引以恢复具体细节;尺度感知控制(SAC)模块融合稀疏追踪数据,确保生成结果与实际观测对齐;运动精炼网络(MRN)则平滑连续姿态并消除量化伪影。实验表明,MotionMAR在AMASS数据集上达到当前最优精度,提供了一种可靠且结构感知的运动重建方法。源码已公开于 http://www.lidarhumanmotion.net/motionmar/。

原文摘要 · Abstract (English)

Human motion follows a temporal hierarchical structure, transitioning from low-frequency global trajectories to high-frequency details. Inspired by the success of multi-level autoregressive models in computer vision, we propose MotionMAR, a coarse-to-fine framework for motion reconstruction from sparse observations. It first estimates the global trajectory of human motion and then gradually refines the temporal details. This architecture consists of four integrated components. The Temporal Multi-scale Tokenization (TMT) VQ-VAE encodes the data at multiple temporal resolutions, separating semantic motion from minor jitters. The Motion Autoregressive Network (MAN) operates in this latent space, predicting motion across scales. It first establishes the global structure through coarse indices and then generates finer indices to recover specific details. Meanwhile, the Scale-Aware Control (SAC) module integrates sparse tracking data to ensure the generated output aligns with actual observations. The Motion Refinement Network (MRN) subsequently smooths consecutive poses and eliminates quantization artifacts. Experiments show that MotionMAR achieves state-of-the-art accuracy on the AMASS dataset, providing a reliable and structure-aware approach for motion reconstruction. The source code is publicly available at http://www.lidarhumanmotion.net/motionmar/.

运动重建自回归人体动作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。