用生成扩散模型减少通信,实现三轮内高效联邦图分类
Communication-efficient Federated Graph Classification via Generative Diffusion Modeling
- 客户端训练生成扩散模型,仅需三轮通信即可完成训练
- 通过生成合成图扩充本地数据,提升非独立同分布场景性能
- 适合数据异构严重的分布式图学习任务
图神经网络(GNN)在捕捉复杂关系方面表现优异,联邦图神经网络(FGNN)则用于在去中心化数据上训练GNN。然而,现有方法面临两大挑战:多轮参数交换导致通信开销大,以及客户端数据非独立同分布(non-IID)。为此,本文提出CeFGC,一种新型联邦图分类范式,将服务器与客户端间的通信限制为仅三轮。核心思想是利用生成扩散模型减少直接通信:各客户端训练一个捕获本地图分布的生成模型,并将其上传至服务器;服务器将该模型分发给所有客户端;客户端使用生成模型合成新图,结合本地图训练本地GNN模型,最后仅上传模型权重供全局聚合。理论分析表明,通信量的输入输出复杂度降为常数级三轮。大量实验在多个真实图数据集上验证了其有效性与效率,在非独立同分布条件下优于现有主流方法,通过对齐本地与全局目标并引入多样化合成图提升训练效果。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) unlock new ways of learning from graph-structured data, proving highly effective in capturing complex relationships and patterns. Federated GNNs (FGNNs) have emerged as a prominent distributed learning paradigm for training GNNs over decentralized data. However, FGNNs face two significant challenges: high communication overhead from multiple rounds of parameter exchanges and non-IID data characteristics across clients. To address these issues, we introduce CeFGC, a novel FGNN paradigm that facilitates efficient GNN training over non-IID data by limiting communication between the server and clients to three rounds only. The core idea of CeFGC is to leverage generative diffusion models to minimize direct client-server communication. Each client trains a generative diffusion model that captures its local graph distribution and shares this model with the server, which then redistributes it back to all clients. Using these generative models, clients generate synthetic graphs combined with their local graphs to train local GNN models. Finally, clients upload their model weights to the server for aggregation into a global GNN model. We theoretically analyze the I/O complexity of communication volume to show that CeFGC reduces to a constant of three communication rounds only. Extensive experiments on several real graph datasets demonstrate the effectiveness and efficiency of CeFGC against state-of-the-art competitors, reflecting our superior performance on non-IID graphs by aligning local and global model objectives and enriching the training set with diverse graphs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。