arXiv:2412.09972cs.LGcs.AI2024-12KDD被引 87

提出PatchSTG框架,高效处理大规模交通预测中的空间依赖建模。

Efficient Large-Scale Traffic Forecasting with Transformers: A Spatial Data Management Perspective

  • 用不规则分块技术减少Transformer计算点数,提升效率。
  • 在4个真实数据集上训练速度提升10倍,显存占用降低4倍。
  • 适合需要快速推理的智能交通系统与城市级交通管理场景。

道路交通预测在城市管理和个人出行等智能交通场景中至关重要。当前主流方法是时空图神经网络(STGNN),但基于动态空间建模的STGNN存在二次复杂度瓶颈,难以应对大规模交通数据。本文从空间数据管理视角出发,提出新型Transformer框架PatchSTG,实现高效且可解释的大规模交通预测。核心创新在于设计不规则空间分块:先通过叶节点容量受限的K-D树递归分割分布不均的交通点,再通过填充与回溯将同一子树内的叶节点合并为等容量、无重叠的补丁。在此基础上,编码器交替使用深度与广度注意力,动态学习补丁内点及同索引补丁间的空间特征。在四个真实世界大规模交通数据集上的实验表明,PatchSTG相较现有方法实现最高达10倍的训练速度提升和4倍的显存占用降低,同时保持领先性能。

原文摘要 · Abstract (English)

Road traffic forecasting is crucial in real-world intelligent transportation scenarios like traffic dispatching and path planning in city management and personal traveling. Spatio-temporal graph neural networks (STGNNs) stand out as the mainstream solution in this task. Nevertheless, the quadratic complexity of remarkable dynamic spatial modeling-based STGNNs has become the bottleneck over large-scale traffic data. From the spatial data management perspective, we present a novel Transformer framework called PatchSTG to efficiently and dynamically model spatial dependencies for large-scale traffic forecasting with interpretability and fidelity. Specifically, we design a novel irregular spatial patching to reduce the number of points involved in the dynamic calculation of Transformer. The irregular spatial patching first utilizes the leaf K-dimensional tree (KDTree) to recursively partition irregularly distributed traffic points into leaf nodes with a small capacity, and then merges leaf nodes belonging to the same subtree into occupancy-equaled and non-overlapped patches through padding and backtracking. Based on the patched data, depth and breadth attention are used interchangeably in the encoder to dynamically learn local and global spatial knowledge from points in a patch and points with the same index of patches. Experimental results on four real world large-scale traffic datasets show that our PatchSTG achieves train speed and memory utilization improvements up to $10\times$ and $4\times$ with the state-of-the-art performance.

交通预测Transformer空间建模高效计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。