arXiv:2412.03188cs.LGcs.AI2024-12被引 4

提出半去中心化训练方法,提升交通预测模型的可扩展性与鲁棒性。

Semi-decentralized Training of Spatio-Temporal Graph Neural Networks for Traffic Prediction

  • 将传感器分组为云边节点,本地训练+模型交换,避免中心节点依赖
  • 在METR-LA和PeMS-BAY数据集上性能接近集中式,支持短中长期预测
  • 解决地理差异影响与图神经网络通信开销大的关键问题,适合大规模部署

在智慧交通中,分布式的高密度传感器产生海量高频时空数据,需实时处理以避免重大中断。传统集中式方法难以随传感网络扩展,且中心组件故障易导致整体失效。为此,本文探索并适配半去中心化训练技术用于时空图神经网络(ST-GNNs)。我们构建仿真框架,将传感器按地理位置分组为多个云边节点,每个节点处理交通图的子图,从其他节点获取节点特征,本地训练模型,并与其他节点交换模型更新以保证一致性,从而提升可扩展性并摆脱对中心聚合器的依赖。我们在大规模交通数据集METR-LA和PeMS-BAY上,对四种训练设置(集中式、传统联邦学习、无服务器联邦学习、闲聊学习)进行对比评估,覆盖短、中、长期车辆速度预测任务。实验表明,半去中心化方案在性能指标上与集中式相当,同时具备更好的可扩展性和容错能力。此外,我们指出现有研究忽略的关键问题:不同地理区域因交通模式差异导致模型表现不一,以及图神经网络因大感受野带来的显著通信开销与计算成本,导致大量数据传输与部分嵌入计算增加。

原文摘要 · Abstract (English)

In smart mobility, large networks of geographically distributed sensors produce vast amounts of high-frequency spatio-temporal data that must be processed in real time to avoid major disruptions. Traditional centralized approaches are increasingly unsuitable to this task, as they struggle to scale with expanding sensor networks, and reliability issues in central components can easily affect the whole deployment. To address these challenges, we explore and adapt semi-decentralized training techniques for Spatio-Temporal Graph Neural Networks (ST-GNNs) in smart mobility domain. We implement a simulation framework where sensors are grouped by proximity into multiple cloudlets, each handling a subgraph of the traffic graph, fetching node features from other cloudlets to train its own local ST-GNN model, and exchanging model updates with other cloudlets to ensure consistency, enhancing scalability and removing reliance on a centralized aggregator. We perform extensive comparative evaluation of four different ST-GNN training setups -- centralized, traditional FL, server-free FL, and Gossip Learning -- on large-scale traffic datasets, the METR-LA and PeMS-BAY datasets, for short-, mid-, and long-term vehicle speed predictions. Experimental results show that semi-decentralized setups are comparable to centralized approaches in performance metrics, while offering advantages in terms of scalability and fault tolerance. In addition, we highlight often overlooked issues in existing literature for distributed ST-GNNs, such as the variation in model performance across different geographical areas due to region-specific traffic patterns, and the significant communication overhead and computational costs that arise from the large receptive field of GNNs, leading to substantial data transfers and increased computation of partial embeddings.

交通预测图神经网络半去中心化联邦学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。