arXiv:2604.09419cs.LGcs.DC2026-04

NOMAD高效生成大规模图嵌入,支持百万级边以上图的分布式计算。

NOMAD: Generating Embeddings for Massive Distributed Graphs

  • 基于MPI的分布式架构,采用近邻性建模提升可扩展性。
  • 在真实图上实现12-370倍端到端加速,比LINE快10-100倍。
  • 适合处理网络与科学领域的大规模图数据,兼顾速度与嵌入质量。

图机器学习的成功依赖于能有效表示节点与边并保持图结构的低维向量嵌入。现有方法通常依赖随机游走反复探索全图以捕捉结构,但面对千万至数十亿边的大规模图时,单机方案因内存和算力不足面临严重可扩展性挑战。本文提出NOMAD,一种基于消息传递接口(MPI)的分布式内存图嵌入框架,实现广泛使用的LINE算法中的近邻性建模。通过多项实用权衡设计,显著降低不规则分布式嵌入方法的通信开销与扩展瓶颈,适用于网络与科学领域的大规模图。NOMAD在基于CPU的NERSC Perlmutter集群上,相较主流多线程LINE与node2vec实现10-100倍中位加速,比分布式PBG快35-76倍,嵌入质量与LINE、node2vec及GraphVite相当,同时在真实图上达成12-370倍端到端加速。

原文摘要 · Abstract (English)

Successful machine learning on graphs or networks requires embeddings that not only represent nodes and edges as low-dimensional vectors but also preserve the graph structure. Established methods for generating embeddings require flexible exploration of the entire graph through repeated use of random walks that capture graph structure with samples of nodes and edges. These methods create scalability challenges for massive graphs with millions-to-billions of edges because single-node solutions have inadequate memory and processing capabilities. We present NOMAD, a distributed-memory graph embedding framework using the Message Passing Interface (MPI) for distributed graphs. NOMAD implements proximity-based models proposed in the widely popular LINE (Large-scale Information Network Embedding) algorithm. We propose several practical trade-offs to improve the scalability and communication overheads confronted by irregular and distributed graph embedding methods, catering to massive-scale graphs arising in web and science domains. NOMAD demonstrates median speedups of 10/100x on CPU-based NERSC Perlmutter cluster relative to the popular reference implementations of multi-threaded LINE and node2vec, 35-76x over distributed PBG, and competitive embedding quality relative to LINE, node2vec, and GraphVite, while yielding 12-370x end-to-end speedups on real-world graphs.

图嵌入分布式大规模计算MPI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。