arXiv:2410.06340cs.LG2024-10被引 4

首个支持百万级节点图学习的联邦图算法框架,兼顾效率与隐私。

FedGraph: A Research Library and Benchmark for Federated Graph Learning

  • 构建了支持加密通信的联邦图学习系统,集成低秩通信优化
  • 在百万节点图上实现端到端训练,通信量降低60%以上
  • 适合研究联邦学习隐私与系统性能的学者和工程团队

联邦图学习是新兴领域,虽已有提升图神经网络精度的算法,但系统性能常被忽视,而这对实际部署至关重要。为此,我们提出 FedGraph,一个面向实用分布式训练与全面基准测试的联邦图学习研究库。该框架支持多种前沿图学习方法,并内置监控模块,重点评估训练中的通信与计算开销。不同于现有平台,FedGraph 原生集成同态加密以增强隐私保护,并支持跨多物理机的可扩展部署,提供系统级性能评估以指导未来算法设计。为提升效率与隐私,我们提出一种针对需预训练通信的算法(如 FedGCN)的低秩通信方案,显著加速预训练与训练阶段。大量实验在三个主要图学习任务上对联邦图学习算法进行基准测试,验证了 FedGraph 是首个支持加密低秩通信且可扩展至百万级节点图的高效联邦图学习框架。

原文摘要 · Abstract (English)

Federated graph learning is an emerging field with significant practical challenges. While algorithms have been proposed to improve the accuracy of training graph neural networks, such as node classification on federated graphs, the system performance is often overlooked, despite it is crucial for real-world deployment. To bridge this gap, we introduce FedGraph, a research library designed for practical distributed training and comprehensive benchmarking of FGL algorithms. FedGraph supports a range of state-of-the-art graph learning methods and includes a monitoring class that evaluates system performance, with a particular focus on communication and computation costs during training. Unlike existing federated learning platforms, FedGraph natively integrates homomorphic encryption to enhance privacy preservation and supports scalable deployment across multiple physical machines with system-level performance evaluation to guide the system design of future algorithms. To enhance efficiency and privacy, we propose a low-rank communication scheme for algorithms like FedGCN that require pre-training communication, accelerating both the pre-training and training phases. Extensive experiments benchmark FGL algorithms on three major graph learning tasks and demonstrate FedGraph as the first efficient FGL framework to support encrypted low-rank communication and scale to graphs with 100 million nodes.

联邦学习图神经网络隐私保护系统优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。