用神经微分方程提升联邦图神经网络,解决非独立同分布图数据难题。
Federated Spectral Graph Transformers Meet Neural Ordinary Differential Equations for Non-IID Graphs
- 结合谱图变换与神经微分方程,增强非独立同分布图的信息捕捉能力。
- 在异质图和同质图上均表现优异,性能接近理想同分布场景下的方法。
- 适合隐私敏感的社交网络、推荐系统等复杂图应用。
图神经网络(GNN)因其能从图结构数据中学习分布式表示而迅速发展。然而,为训练GNN而集中大规模真实世界图数据常因隐私顾虑、监管限制和商业竞争而不切实际。联邦学习(FL)作为一种分布式学习范式,通过协作训练模型来保护数据隐私,提供了可行方案。尽管视觉与语言大模型的联邦学习已取得进展,但针对GNN的联邦学习仍研究不足。为此,我们提出一种基于谱图GNN与神经微分方程(ODE)的新方法,用于联邦学习,在同质与异质图上均表现出色。该方法有效处理非独立同分布(non-IID)数据,且性能可媲美仅在同分布数据上运行的现有方法。其设计具备隐私保护与带宽优化特性,适用于社交网络分析、推荐系统和欺诈检测等涉及复杂、非独立同分布、异质图结构的真实场景。实验表明,本方法在非独立同分布异质图上实现显著提升,并在同质图上也获得更优性能。开源代码见GitHub(https://github.com/SpringWiz11/Fed-GNODEFormer)。
原文摘要 · Abstract (English)
Graph Neural Network (GNN) research is rapidly advancing due to GNNs' capacity to learn distributed representations from graph-structured data. However, centralizing large volumes of real-world graph data for GNN training is often impractical due to privacy concerns, regulatory restrictions, and commercial competition. Federated learning (FL), a distributed learning paradigm, offers a solution by preserving data privacy with collaborative model training. Despite progress in training huge vision and language models, federated learning for GNNs remains underexplored. To address this challenge, we present a novel method for federated learning on GNNs based on spectral GNNs equipped with neural ordinary differential equations (ODE) for better information capture, showing promising results across both homophilic and heterophilic graphs. Our approach effectively handles non-Independent and Identically Distributed (non-IID) data, while also achieving performance comparable to existing methods that only operate on IID data. It is designed to be privacy-preserving and bandwidth-optimized, making it suitable for real-world applications such as social network analysis, recommendation systems, and fraud detection, which often involve complex, non-IID, and heterophilic graph structures. Our results in the area of federated learning on non-IID heterophilic graphs demonstrate significant improvements, while also achieving better performance on homophilic graphs. This work highlights the potential of federated learning in diverse and challenging graph settings. Open-source code available on GitHub (https://github.com/SpringWiz11/Fed-GNODEFormer).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。