arXiv:2511.08888cs.LG2025-11被引 1

用克罗内克积压缩交通网络注意力,提速降耗还更准

Weaver: Kronecker Product Approximations of Spatiotemporal Attention for Traffic Network Forecasting

  • 用克罗内克积分解时空注意力,将复杂度从O(P²N²)降到O(P²N + N²P)
  • 在PEMS-BAY和METR-LA数据集上达到顶尖性能,训练速度更快
  • 引入负边建模和自条件机制,提升交通动态捕捉与训练稳定性

交通网络的时空预测需理解节点间随交通流和行为模式动态演化的交互关系。现有基于Transformer的方法虽提升预测精度,但计算开销大且可解释性差。本文提出Weaver模型,通过克罗内克积近似(KPA)将PN×PN的时空注意力分解为局部P×P时序与N×N空间注意力,实现复杂度从O(P²N²)降至O(P²N + N²P)的并行克罗内克矩阵-向量乘法(P2-KMV),高效完成时空消息传递。为捕捉真实交通行为,引入基于连续塔明托系数(CTC)的有价注意力(Valence Attention),增强图生成精度与训练稳定性;同时设计交通相位词典实现自条件化,充分释放模型能力。在PEMS-BAY与METR-LA数据集上的实验表明,Weaver在各类模型中表现优异,且训练效率显著提升。

原文摘要 · Abstract (English)

Spatiotemporal forecasting on transportation networks is a complex task that requires understanding how traffic nodes interact within a dynamic, evolving system dictated by traffic flow dynamics and social behavioral patterns. The importance of transportation networks and ITS for modern mobility and commerce necessitates forecasting models that are not only accurate but also interpretable, efficient, and robust under structural or temporal perturbations. Recent approaches, particularly Transformer-based architectures, have improved predictive performance but often at the cost of high computational overhead and diminished architectural interpretability. In this work, we introduce Weaver, a novel attention-based model that applies Kronecker product approximations (KPA) to decompose the PN X PN spatiotemporal attention of O(P^2N^2) complexity into local P X P temporal and N X N spatial attention maps. This Kronecker attention map enables our Parallel-Kronecker Matrix-Vector product (P2-KMV) for efficient spatiotemporal message passing with O(P^2N + N^2P) complexity. To capture real-world traffic dynamics, we address the importance of negative edges in modeling traffic behavior by introducing Valence Attention using the continuous Tanimoto coefficient (CTC), which provides properties conducive to precise latent graph generation and training stability. To fully utilize the model's learning capacity, we introduce the Traffic Phase Dictionary for self-conditioning. Evaluations on PEMS-BAY and METR-LA show that Weaver achieves competitive performance across model categories while training more efficiently.

时空预测注意力机制交通网络克罗内克积

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。