用大模型增强时空扩散模型,提升个人用户级流量预测精度
LSDM: LLM-Enhanced Spatio-temporal Diffusion Model for Service-Level Mobile Traffic Prediction
- 结合扩散模型与大语言模型,融合环境上下文信息建模
- 引入上下文后决定系数提升至少2.83%,均方根误差降低8.29%
- 适合需要高精度个性化流量预测的网络优化场景
针对个体用户的业务级移动流量预测对网络效率和服务质量至关重要。现有方法在不同城市环境中适应性差,因个人流量模式不确定性高、环境上下文细节缺失及不同网络服务间复杂依赖关系导致预测不准。为此,我们提出一种基于大语言模型增强的时空扩散模型(LSDM),将扩散模型的生成能力与Transformer的自适应学习能力结合,并通过大语言模型捕捉多模态环境信息,以建模业务级流量模式与动态变化。在真实世界业务级数据集上的大量实验表明,该模型在流量使用预测上表现优异,具备出色泛化能力和适应性。引入上下文信息后,决定系数提升至少2.83%;相较于同类模型如CSDI,均方根误差可降低至少8.29%。代码与数据集将公开于:https://github.com/SoftYuaneR/LSDM。
原文摘要 · Abstract (English)
Service-level mobile traffic prediction for individual users is essential for network efficiency and quality of service enhancement. However, current prediction methods are limited in their adaptability across different urban environments and produce inaccurate results due to the high uncertainty in personal traffic patterns, the lack of detailed environmental context, and the complex dependencies among different network services. These challenges demand advanced modeling techniques that can capture dynamic traffic distributions and rich environmental features. Inspired by the recent success of diffusion models in distribution modeling and Large Language Models (LLMs) in contextual understanding, we propose an LLM-Enhanced Spatio-temporal Diffusion Model (LSDM). LSDM integrates the generative power of diffusion models with the adaptive learning capabilities of transformers, augmented by the ability to capture multimodal environmental information for modeling service-level patterns and dynamics. Extensive evaluations on real-world service-level datasets demonstrate that the model excels in traffic usage predictions, showing outstanding generalization and adaptability. After incorporating contextual information via LLM, the performance improves by at least 2.83% in terms of the coefficient of determination. Compared to models of a similar type, such as CSDI, the root mean squared error can be reduced by at least 8.29%. The code and dataset will be available at: https://github.com/SoftYuaneR/LSDM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。