通过学习边采样概率,高效生成小规模图以提升GNN推理速度与准确率。
SGS-GNN: A Supervised Graph Sparsification method for Graph Neural Networks
- 基于监督学习动态优化边采样概率,生成指定大小的稀疏子图。
- 保留20%边时F1分数相对原图提升4%,异质图上最高提升30%。
- 相比固定采样方法,收敛快一倍,适合大规模图的GNN部署。
我们提出SGS-GNN,一种新型有监督图稀疏化方法,通过学习边采样概率分布,生成用户指定大小的稀疏子图,以降低大型图上GNN推理的计算开销。该方法在损失函数中引入正则项,增强稀疏子图中的同质性,从而提升异质图上GNN的预测精度(节点邻居标签差异大)。此外,支持基于先验条件更新采样概率学习模块,缩小稀疏图搜索空间。相比使用固定分布的方法(如随机采样),SGS-GNN能更有效学习子图搜索空间,显著减少训练轮数。在33个同质与异质图上的实验表明:(i) 仅保留20%边时,SGS-GNN的几何平均F1分数相较原图提升4%,在异质图上最高提升30%;(ii) 相比现有最优方法,在相似稀疏度下,几何平均F1提升4-7%;(iii) 与固定分布稀疏化方法相比,收敛所需轮数减少约一半。
原文摘要 · Abstract (English)
We propose SGS-GNN, a novel supervised graph sparsifier that learns the sampling probability distribution of edges and samples sparse subgraphs of a user-specified size to reduce the computational costs required by GNNs for inference tasks on large graphs. SGS-GNN employs regularizers in the loss function to enhance homophily in sparse subgraphs, boosting the accuracy of GNNs on heterophilic graphs, where a significant number of the neighbors of a node have dissimilar labels. SGS-GNN also supports conditional updates of the probability distribution learning module based on a prior, which helps narrow the search space for sparse graphs. SGS-GNN requires fewer epochs to obtain high accuracies since it learns the search space of subgraphs more effectively than methods using fixed distributions such as random sampling. Extensive experiments using 33 homophilic and heterophilic graphs demonstrate the following: (i) with only 20% of edges retained in the sparse subgraphs, SGS-GNN improves the F1-scores by a geometric mean of 4% relative to the original graph; on heterophilic graphs, the prediction accuracy is better up to 30%. (ii) SGS-GNN outperforms state-of-the-art methods with improvement in F1-scores of 4-7% in geometric mean with similar sparsities in the sampled subgraphs, and (iii) compared to sparsifiers that employ fixed distributions, SGS-GNN requires about half the number of epochs to converge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。