用虚拟节点增强联邦图学习,缓解数据分布差异问题
Virtual Nodes Can Help: Tackling Distribution Shifts in Federated Graph Learning
- 引入可学习的虚拟节点,各客户端个性化生成边连接
- 在四个数据集上显著提升模型性能,优于九种基线方法
- 适合处理存在数据分布偏移的联邦图学习场景
联邦图学习(FGL)使多个客户端能在不共享本地图数据的情况下联合训练强大的图学习模型(如图神经网络,GNN),用于图属性预测等下游任务。然而,现实中客户端间图数据存在显著分布偏移,因各客户端采集数据目的不同。通常,图属性与跨客户端的不变标签相关子结构(即子图)有关,而标签无关子结构则具有客户端特异性。这种分布偏移会降低GNN训练效率,导致FGL性能严重下降。为此,我们提出新型FGL框架FedVN,通过客户端特定的图增强策略和多可学习虚拟节点(VNs)消除分布偏移。具体而言,客户端联合学习一组共享的虚拟节点,并训练个性化边生成器,以客户端特定方式将虚拟节点连接到本地图。此外,我们提供理论分析表明FedVN可消除客户端间图数据的分布偏移。在四个数据集上五种设置下的全面实验表明,所提方法优于九种基线。
原文摘要 · Abstract (English)
Federated Graph Learning (FGL) enables multiple clients to jointly train powerful graph learning models, e.g., Graph Neural Networks (GNNs), without sharing their local graph data for graph-related downstream tasks, such as graph property prediction. In the real world, however, the graph data can suffer from significant distribution shifts across clients as the clients may collect their graph data for different purposes. In particular, graph properties are usually associated with invariant label-relevant substructures (i.e., subgraphs) across clients, while label-irrelevant substructures can appear in a client-specific manner. The issue of distribution shifts of graph data hinders the efficiency of GNN training and leads to serious performance degradation in FGL. To tackle the aforementioned issue, we propose a novel FGL framework entitled FedVN that eliminates distribution shifts through client-specific graph augmentation strategies with multiple learnable Virtual Nodes (VNs). Specifically, FedVN lets the clients jointly learn a set of shared VNs while training a global GNN model. To eliminate distribution shifts, each client trains a personalized edge generator that determines how the VNs connect local graphs in a client-specific manner. Furthermore, we provide theoretical analyses indicating that FedVN can eliminate distribution shifts of graph data across clients. Comprehensive experiments on four datasets under five settings demonstrate the superiority of our proposed FedVN over nine baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。