arXiv:2410.00385cs.LGcs.AI2024-10被引 20

提出高效交通预测模型,计算速度提升100倍且显存减少99.8%

STGformer: Efficient Spatiotemporal Graph Transformer for Traffic Forecasting

  • 单层注意力捕捉高阶时空交互,取代多层结构
  • 在加州8600个传感器数据上实现100倍加速与99.8%显存降低
  • 适合大规模实时交通系统部署,尤其关注计算效率的工程应用

交通预测是智慧城市建设的核心,有助于资源高效配置与交通规划。深度学习凭借对时空数据中复杂非线性模式的建模能力,成为交通预测的重要工具。尽管图神经网络(GCNs)和基于Transformer的模型表现优异,其高昂的计算开销常限制其在大规模路网中的应用。为此,本文提出一种新型时空图变压器(STGformer)架构,有效融合GCN与Transformer的优势,在保持可管理计算成本的同时,精准建模全局与局部交通模式。不同于传统需多层注意力的方案,STG注意力模块在单层内捕捉高阶时空交互,显著降低计算开销。在包含8,600个传感器的加州路网数据集上,批量推理时相比STAEformer实现100倍加速与99.8%的GPU内存占用下降。在LargeST基准测试中,STGformer超越当前先进Transformer方法如PDFormer与STAEformer,展现出突破现有计算与内存瓶颈的潜力,为未来时空建模任务提供坚实基础。

原文摘要 · Abstract (English)

Traffic forecasting is a cornerstone of smart city management, enabling efficient resource allocation and transportation planning. Deep learning, with its ability to capture complex nonlinear patterns in spatiotemporal (ST) data, has emerged as a powerful tool for traffic forecasting. While graph neural networks (GCNs) and transformer-based models have shown promise, their computational demands often hinder their application to real-world road networks, particularly those with large-scale spatiotemporal interactions. To address these challenges, we propose a novel spatiotemporal graph transformer (STGformer) architecture. STGformer effectively balances the strengths of GCNs and Transformers, enabling efficient modeling of both global and local traffic patterns while maintaining a manageable computational footprint. Unlike traditional approaches that require multiple attention layers, STG attention block captures high-order spatiotemporal interactions in a single layer, significantly reducing computational cost. In particular, STGformer achieves a 100x speedup and a 99.8\% reduction in GPU memory usage compared to STAEformer during batch inference on a California road graph with 8,600 sensors. We evaluate STGformer on the LargeST benchmark and demonstrate its superiority over state-of-the-art Transformer-based methods such as PDFormer and STAEformer, which underline STGformer's potential to revolutionize traffic forecasting by overcoming the computational and memory limitations of existing approaches, making it a promising foundation for future spatiotemporal modeling tasks.

交通预测图变压器高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。