arXiv:2505.13140cs.CV2025-05中稿 · Transactions on Ma…被引 3

用缓存流模型实现毫秒级人体动作预测,速度超传统方法30倍。

CacheFlow: Fast Human Motion Prediction by Cached Normalizing Flow

  • 先预计算无条件流模型结果并缓存,再用轻量映射进行条件预测。
  • 在Human3.6M和AMASS数据集上推理仅需约1毫秒,比VAE快4倍,比扩散模型快30倍。
  • 保持高精度密度估计与预测效果,适合实时动作生成场景。

许多用于3D人体动作预测的概率建模方法推理耗时过长,常超过预测时长。为解决这一问题,本文提出CacheFlow——一种基于流模型的人体动作预测新方法。不同于以往依赖条件生成模型的慢速推理,CacheFlow采用无条件流模型将高斯混合分布转换为未来动作的联合分布,并预先计算并缓存其结果。在条件预测阶段,仅需通过一个轻量级模型将历史轨迹映射至高斯混合样本空间,大幅降低计算开销。该两阶段设计使模型在不损失预测精度和表达能力的前提下,实现约1毫秒的推理速度,在Human3.6M和AMASS等标准数据集上分别比当前主流的VAE方法快4倍、比扩散模型快30倍。同时,该方法在密度估计精度上优于现有方法,且预测性能媲美最先进水平。代码与模型已开源。

原文摘要 · Abstract (English)

Many density estimation techniques for 3D human motion prediction require a significant amount of inference time, often exceeding the duration of the predicted time horizon. To address the need for faster density estimation for 3D human motion prediction, we introduce a novel flow-based method for human motion prediction called CacheFlow. Unlike previous conditional generative models that suffer from poor time efficiency, CacheFlow takes advantage of an unconditional flow-based generative model that transforms a Gaussian mixture into the density of future motions. The results of the computation of the flow-based generative model can be precomputed and cached. Then, for conditional prediction, we seek a mapping from historical trajectories to samples in the Gaussian mixture. This mapping can be done by a much more lightweight model, thus saving significant computation overhead compared to a typical conditional flow model. In such a two-stage fashion and by caching results from the slow flow model computation, we build our CacheFlow without loss of prediction accuracy and model expressiveness. This inference process is completed in approximately one millisecond, making it 4 times faster than previous VAE methods and 30 times faster than previous diffusion-based methods on standard benchmarks such as Human3.6M and AMASS datasets. Furthermore, our method demonstrates improved density estimation accuracy and comparable prediction accuracy to a SOTA method on Human3.6M. Our code and models are available at https://github.com/meaten/CacheFlow.

动作预测流模型实时生成高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。