提出新框架加速图扩散方程求解,速度提升百倍。
Faster Local Solvers for Graph Diffusion Equations
- 基于局部扩散过程设计可并行的子线性时间算法
- 在大规模动态图上实现百倍加速,精度仍高
- 适用于GNN局部消息传递,适合GPU部署
高效计算图扩散方程(如个性化PageRank、Katz中心性、热核)对聚类、神经网络训练等任务至关重要。传统迭代方法每轮需访问全图,难以应对大规模图。现有局部求解器多为启发式且串行,仅适配特定扩散类型。本文发现扩散向量具有高度局域性(以参与度比衡量),提出新框架通过局部扩散过程近似求解GDE。该框架揭示了现有局部求解器的次优性,并有效将标准迭代求解器局部化,设计出简单且可证明的子线性时间算法。新方法高度并行,适合GPU实现。实验表明,该框架能快速获得近似扩散向量,在大规模动态图上实现最高百倍加速,且可推广至GNN的局部消息传递机制。
原文摘要 · Abstract (English)
Efficient computation of graph diffusion equations (GDEs), such as Personalized PageRank, Katz centrality, and the Heat kernel, is crucial for clustering, training neural networks, and many other graph-related problems. Standard iterative methods require accessing the whole graph per iteration, making them time-consuming for large-scale graphs. While existing local solvers approximate diffusion vectors through heuristic local updates, they often operate sequentially and are typically designed for specific diffusion types, limiting their applicability. Given that diffusion vectors are highly localizable, as measured by the participation ratio, this paper introduces a novel framework for approximately solving GDEs using a local diffusion process. This framework reveals the suboptimality of existing local solvers. Furthermore, our approach effectively localizes standard iterative solvers by designing simple and provably sublinear time algorithms. These new local solvers are highly parallelizable, making them well-suited for implementation on GPUs. We demonstrate the effectiveness of our framework in quickly obtaining approximate diffusion vectors, achieving up to a hundred-fold speed improvement, and its applicability to large-scale dynamic graphs. Our framework could also facilitate more efficient local message-passing mechanisms for GNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。