用时空引导的LLM统一解决交通预测与缺失数据补全问题。
U-STS-LLM A Unified Spatio-Temporal Steered Large Language Model for Traffic Prediction and Imputation

- 通过动态时空注意力偏置生成器,显式引导大模型关注关键时空关系。
- 在真实蜂窝网络数据上实现长时程预测与高缺失率补全的新基准性能。
- 适合需要高效、稳定处理复杂时空数据的系统设计者与研究者。
现代蜂窝网络的高效运行依赖于对时空流量数据的精确分析。掌握这些模式对于核心网络功能至关重要,包括提前预测未来负载以避免拥塞,以及补全因传感器故障或传输错误导致的缺失数据以保证数据连续性。尽管二者密切相关,但预测与补全长期作为独立子领域发展。主流方法时空图神经网络(STGNNs)虽有效,却往往专用、计算成本高且泛化能力有限。同时,适配大型预训练语言模型(LLMs)为序列建模提供强大替代方案,但现有方法结构引导弱,导致收敛不稳定,且仅聚焦于预测。为此,我们提出U-STS-LLM,一个基于时空引导大语言模型的统一框架。其核心创新在于动态时空注意力偏置生成器,可融合持久的功能图与瞬时节点状态,显式引导模型注意力。结合部分冻结的骨干网络(通过低秩适配LoRA微调)与门控自适应融合机制,模型实现稳定、参数高效的适应。在统一多任务目标下训练,U-STS-LLM学习到整体数据表征。大量实验在真实蜂窝网络数据集上表明,该模型在长时程预测与高缺失率补全任务中均达到新最优表现,同时保持出色的训练效率与稳定性,为在结构化非语言领域利用基础模型提供了新范式。
原文摘要 · Abstract (English)
The efficient operation of modern cellular networks hinges on the accurate analysis of spatio-temporal traffic data. Mastering these patterns is essential for core network functions, chiefly forecasting future load to pre-empt congestion and imputing missing values caused by sensor failures or transmission errors to ensure data continuity. While deeply connected, forecasting and imputation have historically evolved as separate sub-fields. The dominant paradigm, Spatio-Temporal Graph Neural Networks (STGNNs), while effective, are often specialized, computationally intensive, and exhibit limited generalization. Concurrently, adapting large pre-trained language models (LLMs) offers a powerful alternative for sequence modeling, yet existing approaches provide weak structural guidance, leading to unstable convergence and a narrow focus on forecasting. To bridge these gaps, we propose U-STS-LLM, a unified framework built on a spatio-temporally steered LLM. Our core innovation is a Dynamic Spatio-Temporal Attention Bias Generator that synthesizes a persistent functional graph with transient nodal states to explicitly steer the LLM's attention. Coupled with a partially frozen backbone tuned via Low-Rank Adaptation (LoRA) and a Gated Adaptive Fusion mechanism, the model achieves stable, parameter-efficient adaptation. Trained under a unified multi-task objective, U-STS-LLM learns a holistic data representation. Extensive experiments on real-world cellular datasets demonstrate that U-STS-LLM establishes new state-of-the-art performance in both long-horizon forecasting and high-missing-rate imputation, while maintaining remarkable training efficiency and stability, offering a novel blueprint for harnessing foundation models in structured, non-linguistic domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。