arXiv:2511.19717cs.SIcs.LG2025-11

提升社区感知网络生成速度,支持百亿级节点大规模模拟

Large Scale Community-Aware Network Generation

  • 通过并行化与算法优化,重构社区结构生成流程
  • 最快达139倍加速,支持超1亿节点、近20亿边的网络生成
  • 适合需要大规模真实社区结构数据的研究者使用

社区检测(或称网络聚类)用于识别网络中的隐含社区结构。由于现实网络中缺乏标注的真值,评估这些算法面临巨大挑战。为此,研究者采用合成网络生成器,生成带有真实社区标签的网络。RECCS是一种算法,输入网络及其聚类结果后,通过模块化流程生成合成网络,使每个生成的社区保持原始社区的连通性、最小度和度分布等关键特性。输出包含合成网络及所有节点的互斥真值社区标签。本文提出两个增强版本:RECCS+在保持原算法一致性的前提下,引入协调器实现多进程间组件并行,支持多线程;RECCS++在此基础上进一步优化算法,获得更显著提速。实验表明,RECCS+与RECCS++在基准数据集上分别实现最高49倍和139倍的加速,其中RECCS++的性能提升伴随轻微精度损失。借助此性能突破,RECCS++可扩展至超过1亿节点、近20亿边的大规模网络。

原文摘要 · Abstract (English)

Community detection, or network clustering, is used to identify latent community structure in networks. Due to the scarcity of labeled ground truth in real-world networks, evaluating these algorithms poses significant challenges. To address this, researchers use synthetic network generators that produce networks with ground-truth community labels. RECCS is one such algorithm that takes a network and its clustering as input and generates a synthetic network through a modular pipeline. Each generated ground truth cluster preserves key characteristics of the corresponding input cluster, including connectivity, minimum degree, and degree sequence distribution. The output consists of a synthetically generated network, and disjoint ground truth cluster labels for all nodes. In this paper, we present two enhanced versions: RECCS+ and RECCS++. RECCS+ maintains algorithmic fidelity to the original RECCS while introducing parallelization through an orchestrator that coordinates algorithmic components across multiple processes and employs multithreading. RECCS++ builds upon this foundation with additional algorithmic optimizations to achieve further speedup. Our experimental results demonstrate that RECCS+ and RECCS++ achieve speedups of up to 49x and 139x respectively on our benchmark datasets, with RECCS++'s additional performance gains involving a modest accuracy tradeoff. With this newfound performance, RECCS++ can now scale to networks with over 100 million nodes and nearly 2 billion edges.

网络生成社区检测大规模模拟并行计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。