arXiv:2501.10459cs.LGcs.CE2025-01AAAI被引 35

用轻量学生模型加速交通预测,速度提升5到40倍。

Efficient Traffic Prediction Through Spatio-Temporal Distillation

  • 通过时空知识蒸馏,让小模型学习大模型的全局模式。
  • 相比顶尖GNN模型,预测速度提升5至40倍,精度仍领先。
  • 适合部署在资源受限的实时交通系统中。

图神经网络(GNN)因能通过基于图的消息传递框架学习时空模式表示,在交通流预测中受到广泛关注。尽管GNN在处理交通数据集方面表现优异,但其在真实应用中的部署受限于高阶消息传递带来的可扩展性问题。此外,随着层数增加,GNN可能出现过平滑问题,导致区域表示难以区分,性能下降。为此,我们提出一种新的知识蒸馏范式LightST,将高容量教师模型的时空知识迁移到轻量学生模型中。具体而言,我们设计了一种时空知识蒸馏框架,帮助学生MLP捕捉图结构的全局时空模式,同时通过自适应知识蒸馏缓解过平滑问题。大量实验表明,LightST相比最先进的时空GNN模型,交通流预测速度提升5倍至40倍,且保持更优精度。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) have gained considerable attention in recent years for traffic flow prediction due to their ability to learn spatio-temporal pattern representations through a graph-based message-passing framework. Although GNNs have shown great promise in handling traffic datasets, their deployment in real-life applications has been hindered by scalability constraints arising from high-order message passing. Additionally, the over-smoothing problem of GNNs may lead to indistinguishable region representations as the number of layers increases, resulting in performance degradation. To address these challenges, we propose a new knowledge distillation paradigm termed LightST that transfers spatial and temporal knowledge from a high-capacity teacher to a lightweight student. Specifically, we introduce a spatio-temporal knowledge distillation framework that helps student MLPs capture graph-structured global spatio-temporal patterns while alleviating the over-smoothing effect with adaptive knowledge distillation. Extensive experiments verify that LightST significantly speeds up traffic flow predictions by 5X to 40X compared to state-of-the-art spatio-temporal GNNs, all while maintaining superior accuracy.

交通预测知识蒸馏图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。