arXiv:2412.13607cs.LGcs.ET2024-12被引 3

用MLP设计高效交通预测框架,提升大尺度交通流预测精度与速度。

PreMixer: MLP-Based Pre-training Enhanced MLP-Mixers for Large-scale Traffic Forecasting

  • 基于MLP构建预训练与预测模型,无需复杂图结构
  • 通过分块掩码建模学习长期历史数据,提升上下文表征能力
  • 在大规模数据集上实现高精度与低计算开销,适合城市级应用

在城市计算中,精确快速地预测交通网络的多变量时间序列数据至关重要。此类数据包含传感器位置、道路网络布局等空间上下文,并呈现复杂的时序模式,显著增加交通管理、智能出行需求和城市规划中的预测难度。因此,亟需对更大地理范围和更高时间覆盖度的交通流进行预测。然而,现有研究受限于模型固有的低效性,难以适应大规模交通网络的应用。本文提出一种新框架 PreMixer,融合基于多层感知机(MLP)的预测模型与预训练机制。该框架综合考虑不同时间窗口的时序依赖性,并处理空间动态变化。此外,引入时空位置编码以应对时空异质性,无需依赖预定义图结构。创新的预训练模型采用简单的分块式MLP进行掩码时间序列建模,从长期历史数据中分段学习,生成丰富的上下文表示。该方法在不显著增加计算开销的前提下,提升下游预测模型性能。大量实验验证了其在大规模交通数据集上的表现,达到与当前最优水平相当的效果,同时保持高计算效率。

原文摘要 · Abstract (English)

In urban computing, precise and swift forecasting of multivariate time series data from traffic networks is crucial. This data incorporates additional spatial contexts such as sensor placements and road network layouts, and exhibits complex temporal patterns that amplify challenges for predictive learning in traffic management, smart mobility demand, and urban planning. Consequently, there is an increasing need to forecast traffic flow across broader geographic regions and for higher temporal coverage. However, current research encounters limitations because of the inherent inefficiency of model and their unsuitability for large-scale traffic network applications due to model complexity. This paper proposes a novel framework, named PreMixer, designed to bridge this gap. It features a predictive model and a pre-training mechanism, both based on the principles of Multi-Layer Perceptrons (MLP). The PreMixer comprehensively consider temporal dependencies of traffic patterns in different time windows and processes the spatial dynamics as well. Additionally, we integrate spatio-temporal positional encoding to manage spatiotemporal heterogeneity without relying on predefined graphs. Furthermore, our innovative pre-training model uses a simple patch-wise MLP to conduct masked time series modeling, learning from long-term historical data segmented into patches to generate enriched contextual representations. This approach enhances the downstream forecasting model without incurring significant time consumption or computational resource demands owing to improved learning efficiency and data handling flexibility. Our framework achieves comparable state-of-the-art performance while maintaining high computational efficiency, as verified by extensive experiments on large-scale traffic datasets.

交通预测MLP预训练时空建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。