arXiv:2506.00770cs.LGcs.AI2025-06被引 1

用可学习的交互矩阵替代注意力,提升时空预测精度与可解释性

Beyond Attention: Learning Spatio-Temporal Dynamics with Emergent Interpretable Topologies

  • 用可学习的对称交互矩阵替代传统注意力,不依赖固定图结构
  • 在两个数据集上预测误差降低21%和6%,训练时间减少60%-70%
  • 学习到的结构能揭示社区化拓扑,兼具预测性能与可解释性

时空预测在交通预测、能源需求建模和气象监测中至关重要。尽管图注意力网络(GAT)常用于建模空间依赖,但其依赖预定义邻接关系和动态注意力分数,引入归纳偏置并增加计算开销,影响可解释性。我们提出InterGAT,一种简化版GAT,用全可学习的对称节点交互矩阵替代掩码注意力,无需固定图拓扑即可捕捉潜在空间关系。其结合GRU的时序解码器——InterGAT-GRU,在SZ-Taxi数据集上预测精度至少提升21%,在Los-Loop数据集上提升6%,且所有预测时长(15至60分钟)均表现更优。训练时间相较基线GAT-GRU减少60%-70%。关键的是,学习到的交互矩阵呈现可解释结构:恢复出稀疏、拓扑感知的注意力模式,与社区结构一致。谱分析与聚类结果表明,模型同时捕捉局部与全局动态,揭示驱动预测的功能拓扑。这说明结构学习可在动态图领域实现预测、效率与可解释性的统一。

原文摘要 · Abstract (English)

Spatio-temporal forecasting is critical in applications such as traffic prediction, energy demand modeling, and weather monitoring. While Graph Attention Networks (GATs) are popular for modeling spatial dependencies, they rely on predefined adjacency structures and dynamic attention scores, introducing inductive biases and computational overhead that can obscure interpretability. We propose InterGAT, a simplified alternative to GAT that replaces masked attention with a fully learnable, symmetric node interaction matrix, capturing latent spatial relationships without relying on fixed graph topologies. Our framework, InterGAT-GRU, which incorporates a GRU-based temporal decoder, outperforms the baseline GAT-GRU in forecasting accuracy, achieving at least a 21% improvement on the SZ-Taxi dataset and a 6% improvement on the Los-Loop dataset across all forecasting horizons (15 to 60 minutes). Additionally, we observed reduction in training time by 60-70% compared to GAT-GRU baseline. Crucially, the learned interaction matrix reveals interpretable structure: it recovers sparse, topology-aware attention patterns that align with community structure. Spectral and clustering analyses show that the model captures both localized and global dynamics, offering insights into the functional topology driving predictions. This highlights how structure learning can simultaneously support prediction, computational efficiency, and topological interpretabil-ity in dynamic graph-based domains.

时空预测图神经网络可解释性结构学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。