arXiv:2409.12456cs.CVcs.RO2024-09被引 2

用知识蒸馏与贝叶斯优化,实现毫秒级3D人体动作预测。

Bayesian-Optimized One-Step Diffusion Model with Knowledge Distillation for Real-Time 3D Human Motion Prediction

  • 将扩散模型压缩为单步MLP结构,加速推理
  • 在Human3.6M数据集上达到100+帧/秒,延迟低于10毫秒
  • 适合工业机器人实时协同场景

人体动作预测是人机协作的核心,机器人需基于历史运动预判人类未来动作以主动规划路径,保障近距离协作安全。扩散模型虽能生成高质量且多样化的动作样本,但生成过程缓慢,需多次模型评估,难以满足实时性要求。为此,本文提出一种基于知识蒸馏与贝叶斯优化的一步式多层感知机(MLP)扩散模型,用于动作预测。首先,将预训练的扩散模型TransFusion直接蒸馏为具有相同去噪器结构的一步扩散模型;随后,移除原去噪器中计算开销大的组件,并再次使用知识蒸馏将其压缩为仅基于MLP的小型模型。通过贝叶斯优化调优小型扩散模型的超参数。在基准数据集上的大量实验表明,该方法显著提升推理速度,在Human3.6M数据集上实现超过100帧/秒的生成速率,延迟低于10毫秒,性能损失可忽略不计,实现真正实时预测。

原文摘要 · Abstract (English)

Human motion prediction is a cornerstone of human-robot collaboration (HRC), as robots need to infer the future movements of human workers based on past motion cues to proactively plan their motion, ensuring safety in close collaboration scenarios. The diffusion model has demonstrated remarkable performance in predicting high-quality motion samples with reasonable diversity, but suffers from a slow generative process which necessitates multiple model evaluations, hindering real-world applications. To enable real-time prediction, in this work, we propose training a one-step multi-layer perceptron-based (MLP-based) diffusion model for motion prediction using knowledge distillation and Bayesian optimization. Our method contains two steps. First, we distill a pretrained diffusion-based motion predictor, TransFusion, directly into a one-step diffusion model with the same denoiser architecture. Then, to further reduce the inference time, we remove the computationally expensive components from the original denoiser and use knowledge distillation once again to distill the obtained one-step diffusion model into an even smaller model based solely on MLPs. Bayesian optimization is used to tune the hyperparameters for training the smaller diffusion model. Extensive experimental studies are conducted on benchmark datasets, and our model can significantly improve the inference speed, achieving real-time prediction without noticeable degradation in performance.

动作预测扩散模型实时推理知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。