用知识蒸馏让扩散模型变小变快,适合自动驾驶实时轨迹预测。
Collaborative-Distilled Diffusion Models (CDDM) for Accelerated and Lightweight Trajectory Prediction
- 通过渐进式协作蒸馏,将大模型知识迁移到轻量学生模型。
- 仅用4或2步采样、231K参数,性能保留96.2%的ADE和95.5%的FDE。
- 适合资源受限场景,如车载系统部署,兼顾速度与多样性。
轨迹预测是自动驾驶与智能交通系统的核心任务,支持高效运动规划与实时交通安全管理。扩散模型在概率性轨迹预测中表现优异,但其庞大的模型规模与缓慢的采样过程限制了实际应用。本文提出协同蒸馏扩散模型(CDDM),一种面向实时、轻量级轨迹预测的新方法。基于协同渐进蒸馏(CPD),CDDM 逐步将高性能教师扩散模型的知识迁移至轻量学生模型,同时减少采样步骤与模型参数。引入双信号正则化蒸馏损失,融合教师模型与真实数据的指导,缓解过拟合风险并保证鲁棒性能。在 ETH-UCY 行人基准与 nuScenes 车辆基准上的大量实验表明,CDDM 达到先进水平:在行人轨迹上保持基线模型 96.2% 的 ADE 与 95.5% 的 FDE 性能,仅需 231K 参数与 4 或 2 次采样,对应 161 倍压缩、31 倍加速与 9 毫秒延迟。定性结果进一步显示,CDDM 在动态交互与复杂社会行为下仍能生成多样且准确的轨迹。该方法有效弥合高性能生成模型与实际部署约束之间的差距,为自动驾驶与智能交通系统提供资源高效的概率预测方案。代码已开源:https://github.com/bingzhangw/CDDM。
原文摘要 · Abstract (English)
Trajectory prediction is a fundamental task in Autonomous Vehicles (AVs) and Intelligent Transportation Systems (ITS), supporting efficient motion planning and real-time traffic safety management. Diffusion models have recently demonstrated strong performance in probabilistic trajectory prediction, but their large model size and slow sampling process hinder real-world deployment. This paper proposes Collaborative-Distilled Diffusion Models (CDDM), a novel method for real-time and lightweight trajectory prediction. Built upon Collaborative Progressive Distillation (CPD), CDDM progressively transfers knowledge from a high-capacity teacher diffusion model to a lightweight student model, jointly reducing both the number of sampling steps and the model size across distillation iterations. A dual-signal regularized distillation loss is further introduced to incorporate guidance from both the teacher and ground-truth data, mitigating potential overfitting and ensuring robust performance. Extensive experiments on the ETH-UCY pedestrian benchmark and the nuScenes vehicle benchmark demonstrate that CDDM achieves state-of-the-art prediction accuracy. The well-distilled CDDM retains 96.2% and 95.5% of the baseline model's ADE and FDE performance on pedestrian trajectories, while requiring only 231K parameters and 4 or 2 sampling steps, corresponding to 161x compression, 31x acceleration, and 9 ms latency. Qualitative results further show that CDDM generates diverse and accurate trajectories under dynamic agent behaviors and complex social interactions. By bridging high-performing generative models with practical deployment constraints, CDDM enables resource-efficient probabilistic prediction for AVs and ITS. Code is available at https://github.com/bingzhangw/CDDM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。