arXiv:2605.25543cs.AI2026-05

提出自适应分解Transformer,精准捕捉交通流的周期与突发变化。

ADMFormer: An Adaptive-Decomposition Transformer with Time-Varying Masked Spatial Attention for Traffic Forecasting

论文配图:ADMFormer: An Adaptive-Decomposition Transformer with Time-Varying Masked Spatial Attention for Traffic Forecasting
图 1 · 摘自论文原文
  • 将交通流分解为规律成分与波动成分,分别建模
  • 在四个真实数据集上达到最优预测精度
  • 适合需要高精度交通预测的智能交通系统

准确的交通流量预测对智能交通系统至关重要,支持众多实际应用。然而,由于两个关键因素仍具挑战性:(1) 交通序列包含异构时间模式,稳定周期规律与事件驱动波动共存,现有方法常以统一表征处理,限制了对细粒度时间动态的捕捉;(2) 节点间的空间依赖本质上是动态且稀疏的,而密集的全对注意力常引入冗余交互并放大噪声。为此,我们提出 ADMFormer:一种具有时变掩码空间注意力的自适应分解变压器。具体而言,ADMFormer首先采用时-节点自适应门控机制,将交通信号分解为随时间和节点变化的主导规律与残差波动。随后设计双分支时间模块,分别从两部分中捕捉全局周期依赖与高频异常变化。此外,引入时变掩码空间注意力,基于实时交通状态稀疏化空间交互,有效保留动态且有信息量的依赖关系。在四个真实世界数据集上的大量实验表明,ADMFormer实现了当前最佳性能。

原文摘要 · Abstract (English)

Accurate traffic forecasting is essential for intelligent transportation systems, supporting a wide range of real-world applications. However, it remains challenging due to two key factors:~(1) Traffic series contain heterogeneous temporal patterns, where stable periodic regularities coexist with event-driven fluctuations. Existing methods often treat them within a unified representation, limiting their ability to capture fine-grained temporal dynamics.~(2)Spatial dependencies among nodes are inherently dynamic and sparse, while dense all-pairs attention often introduces redundant interactions and amplifies noise. To address these issues, we propose ADMFormer, an Adaptive-Decomposition Transformer with Time-Varying Masked Spatial Attention. Specifically, ADMFormer first employs a time-node adaptive gating mechanism to decouple traffic signals into dominant regularities and residual fluctuations that vary across time and nodes. A dual-branch temporal module is then designed to separately capture global periodic dependencies and high-frequency irregular variations from these two decomposed components. Furthermore, ADMFormer introduces a time-varying masked spatial attention that sparsifies spatial interactions based on real-time traffic states, thereby effectively preserving dynamic and informative dependencies. Extensive experiments on four real-world datasets demonstrate that ADMFormer achieves state-of-the-art performance.

交通预测Transformer时空建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。