用扩散模型与大语言模型融合提升多模式交通预测精度。
STLLM-DF: A Spatial-Temporal Large Language Model with Diffusion for Enhanced Multi-Mode Traffic System Forecasting
- 结合扩散模型与非预训练大语言模型,动态建模时空关系。
- 在多个指标上平均降低2.40% MAE、4.50% RMSE和1.51% MAPE。
- 适合需要高鲁棒性多任务交通预测的系统集成场景。
智能交通系统(ITS)快速发展带来了多模态交通数据缺失及统一框架下处理多样化序列任务的挑战。为此,我们提出空间-时间大语言模型扩散模型(STLLM-DF),融合去噪扩散概率模型(DDPMs)与大语言模型(LLMs),以提升多任务交通预测性能。DDPM具备强去噪能力,可从噪声输入中恢复底层数据模式,尤其适用于复杂交通系统。非预训练的LLM则能动态适应多模态网络中的时空关系,支持长短期预测下的多样化任务管理。大量实验表明,STLLM-DF持续优于现有模型,在平均绝对误差(MAE)、均方根误差(RMSE)和平均绝对百分比误差(MAPE)上分别降低2.40%、4.50%和1.51%。该模型显著提升了集中式智能交通系统的预测准确性、鲁棒性与整体性能,通过冻结的Transformer语言模型与扩散技术的融合,为更有效的时空交通预测开辟了新路径。
原文摘要 · Abstract (English)
The rapid advancement of Intelligent Transportation Systems (ITS) presents challenges, particularly with missing data in multi-modal transportation and the complexity of handling diverse sequential tasks within a centralized framework. To address these issues, we propose the Spatial-Temporal Large Language Model Diffusion (STLLM-DF), an innovative model that leverages Denoising Diffusion Probabilistic Models (DDPMs) and Large Language Models (LLMs) to improve multi-task transportation prediction. The DDPM's robust denoising capabilities enable it to recover underlying data patterns from noisy inputs, making it particularly effective in complex transportation systems. Meanwhile, the non-pretrained LLM dynamically adapts to spatial-temporal relationships within multi-modal networks, allowing the system to efficiently manage diverse transportation tasks in both long-term and short-term predictions. Extensive experiments demonstrate that STLLM-DF consistently outperforms existing models, achieving an average reduction of 2.40\% in MAE, 4.50\% in RMSE, and 1.51\% in MAPE. This model significantly advances centralized ITS by enhancing predictive accuracy, robustness, and overall system performance across multiple tasks, thus paving the way for more effective spatio-temporal traffic forecasting through the integration of frozen transformer language models and diffusion techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。