用高斯过程高效压缩大图,无需反复训练模型。
Efficient Graph Condensation via Gaussian Process
- 用高斯过程建模图结构,避免传统迭代训练
- 新核函数融合邻域信息,提升节点依赖建模能力
- 连续松弛二值邻接矩阵,支持梯度优化
图压缩通过减小大规模图的规模来保持性能,缓解图神经网络在大数据集上的计算效率问题。现有方法多依赖双层优化,需大量GNN训练,限制可扩展性。本文提出基于高斯过程的图压缩方法(GCGP),利用高斯过程将压缩图视为观测数据,估计预测的后验分布,从而避免了传统方法中耗时的迭代训练。为增强对函数值间依赖关系的建模能力,设计了一种融合结构信息的专用核函数,通过局部邻域聚合扩大输入节点的感受野,更有效地表示节点间的复杂依赖关系。针对压缩图中二值结构信息的优化难题,引入Concrete随机变量,将二值邻接矩阵近似为连续形式,实现可微表达,进而应用梯度优化技术处理离散图结构。实验表明,GCGP能高效压缩大规模图数据,同时保持预测性能,有效解决可扩展性与效率挑战。代码已公开于https://github.com/WANGLin0126/GCGP。
原文摘要 · Abstract (English)
Graph condensation reduces the size of large graphs while preserving performance, addressing the scalability challenges of Graph Neural Networks caused by computational inefficiencies on large datasets. Existing methods often rely on bi-level optimization, requiring extensive GNN training and limiting their scalability. To address these issues, this paper proposes Graph Condensation via Gaussian Process (GCGP), a novel and computationally efficient approach to graph condensation. GCGP utilizes a Gaussian Process (GP), with the condensed graph serving as observations, to estimate the posterior distribution of predictions. This approach eliminates the need for the iterative and resource-intensive training typically required by GNNs. To enhance the capability of the GCGP in capturing dependencies between function values, we derive a specialized covariance function that incorporates structural information. This covariance function broadens the receptive field of input nodes by local neighborhood aggregation, thereby facilitating the representation of intricate dependencies within the nodes. To address the challenge of optimizing binary structural information in condensed graphs, Concrete random variables are utilized to approximate the binary adjacency matrix in a continuous counterpart. This relaxation process allows the adjacency matrix to be represented in a differentiable form, enabling the application of gradient-based optimization techniques to discrete graph structures. Experimental results show that the proposed GCGP method efficiently condenses large-scale graph data while preserving predictive performance, addressing the scalability and efficiency challenges. The implementation of our method is publicly available at https://github.com/WANGLin0126/GCGP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。