用预训练+精炼策略,加速大规模图划分且不损失质量。
Towards Faster Graph Partitioning via Pre-training and Inductive Inference
- 先在小图上预训练图学习模型,再用其直接推断大图划分结果
- 相比从头运行优化算法,速度提升明显,质量下降不足2%
- 适合需要快速响应的大规模动态图划分场景
图划分(GP)是将图的节点集划分为内部连接紧密块的经典问题。受IEEE HPEC图挑战赛及预训练技术(如大语言模型)启发,我们提出基于新型预训练与精炼范式的PR-GPT(Pre-trained & Refined Graph ParTitioning)。首先在具有多种拓扑特性的小型合成图上离线预训练深度图学习(DGL)模型;通过DGL的归纳推理能力,可直接将冻结参数的预训练模型推广至大规模图,生成可行的图划分结果。进一步以该结果作为高效划分方法(如InfoMap)的良好初始化,进行质量精炼。在此设置下,PR-GPT的在线泛化与精炼不仅受益于迁移带来的质量优势,还保证了无需重训练的高推理效率。通过降低精炼方法需处理的图规模,PR-GPT还具备支持流式图划分的潜力。在图挑战赛基准上的实验表明,相较于从头运行精炼方法,PR-GPT能在大规模图上实现更快的图划分,且质量下降不足2%。代码将公开于https://github.com/KuroginQin/PRGPT。
原文摘要 · Abstract (English)
Graph partitioning (GP) is a classic problem that divides the node set of a graph into densely-connected blocks. Following the IEEE HPEC Graph Challenge and recent advances in pre-training techniques (e.g., large-language models), we propose PR-GPT (Pre-trained & Refined Graph ParTitioning) based on a novel pre-training & refinement paradigm. We first conduct the offline pre-training of a deep graph learning (DGL) model on small synthetic graphs with various topology properties. By using the inductive inference of DGL, one can directly generalize the pre-trained model (with frozen model parameters) to large graphs and derive feasible GP results. We also use the derived partition as a good initialization of an efficient GP method (e.g., InfoMap) to further refine the quality of partitioning. In this setting, the online generalization and refinement of PR-GPT can not only benefit from the transfer ability regarding quality but also ensure high inference efficiency without re-training. Based on a mechanism of reducing the scale of a graph to be processed by the refinement method, PR-GPT also has the potential to support streaming GP. Experiments on the Graph Challenge benchmark demonstrate that PR-GPT can ensure faster GP on large-scale graphs without significant quality degradation, compared with running a refinement method from scratch. We will make our code public at https://github.com/KuroginQin/PRGPT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。