arXiv:2511.09261cs.LG2025-11

提出分布式图神经网络框架,解决大规模组合优化的内存与扩展性难题

A Distributed Training Architecture For Combinatorial Optimization

  • 将大图分块训练,避免单机加载全邻接矩阵
  • 结合强化学习捕捉跨节点约束,提升解的质量
  • 在真实社交网络与复杂图上验证了高效与可扩展性

近年来,图神经网络(GNN)被广泛用于求解组合优化问题。然而,现有方法在处理复杂图时精度有限,且可扩展性差,因完整训练需一次性加载整个邻接矩阵和所有嵌入表示,易导致单机内存溢出,严重限制其在大规模场景的应用。为此,我们提出一种基于分布式GNN的组合优化训练框架。具体而言,首先将大图划分为多个小子图,分别进行完整训练,为局部优化奠定基础;随后利用强化学习(RL)根据GNN输出采取动作,以学习跨节点间的约束关系。在真实大规模社交网络数据集(如Facebook、Youtube)及合成高复杂度图上开展的大量实验表明,该框架在解的质量和计算效率方面均优于现有最先进方法。此外,对大规模图实例的实验也验证了模型的可扩展性。

原文摘要 · Abstract (English)

In recent years, graph neural networks (GNNs) have been widely applied in tackling combinatorial optimization problems. However, existing methods still suffer from limited accuracy when addressing that on complex graphs and exhibit poor scalability, since full training requires loading the whole adjacent matrix and all embeddings at a time, the it may results in out of memory of a single machine. This limitation significantly restricts their applicability to large-scale scenarios. To address these challenges, we propose a distributed GNN-based training framework for combinatorial optimization. In details, firstly, large graph is partition into several small subgraphs. Then the individual subgraphs are full trained, providing a foundation for efficient local optimization. Finally, reinforcement learning (RL) are employed to take actions according to GNN output, to make sure the restrictions between cross nodes can be learned. Extensive experiments are conducted on both real large-scale social network datasets (e.g., Facebook, Youtube) and synthetically generated high-complexity graphs, which demonstrate that our framework outperforms state-of-the-art approaches in both solution quality and computational efficiency. Moreover, the experiments on large graph instances also validate the scalability of the model.

图神经网络组合优化分布式训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。