通过分层粗化并行加速大规模图聚类,提升效率与精度。
PASCO (PArallel Structured COarsening): an overlay to speed up graph clustering algorithms
- 构建小图并行聚类,再用最优传输对齐结果
- 在真实与合成数据上显著降低计算时间
- 适合处理超大图且社区数量多的场景
图节点聚类是图分析的核心任务,但传统方法如谱聚类需计算拉普拉斯矩阵的谱分解,难以适用于包含大量社区的大规模图。本文提出PASCO框架,通过三步实现加速:首先利用高效且结构保持的粗化算法生成多个独立的小图;其次在每个小图上并行运行聚类算法,得到初始图的多个划分;最后通过最优传输方法对齐并融合这些划分,输出最终结果。PASCO基于两大创新:支持并行化的全局算法结构,以及快速且实证有效的图粗化算法。实验表明,PASCO在计算效率、结构保真度和划分质量方面均表现优异,验证了其在合成及真实世界图数据集上的有效性。
原文摘要 · Abstract (English)
Clustering the nodes of a graph is a cornerstone of graph analysis and has been extensively studied. However, some popular methods are not suitable for very large graphs: e.g., spectral clustering requires the computation of the spectral decomposition of the Laplacian matrix, which is not applicable for large graphs with a large number of communities. This work introduces PASCO, an overlay that accelerates clustering algorithms. Our method consists of three steps: 1-We compute several independent small graphs representing the input graph by applying an efficient and structure-preserving coarsening algorithm. 2-A clustering algorithm is run in parallel onto each small graph and provides several partitions of the initial graph. 3-These partitions are aligned and combined with an optimal transport method to output the final partition. The PASCO framework is based on two key contributions: a novel global algorithm structure designed to enable parallelization and a fast, empirically validated graph coarsening algorithm that preserves structural properties. We demonstrate the strong performance of 1 PASCO in terms of computational efficiency, structural preservation, and output partition quality, evaluated on both synthetic and real-world graph datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。