提出新方法同时解决图联邦学习中的子图间与子图内异质性问题。
Modeling Inter-Intra Heterogeneity for Graph Federated Learning
- 构建分层变分模型,从多层级推断子图数据分布以提升相似度计算可靠性。
- 将子图分解为多个潜在因子并解耦参数,有效捕捉子图内部异质性。
- 在5个异质图数据集上性能超越次优方法5.79%,适用于复杂关系图数据。
联邦学习中的异质性是核心挑战,尤其在图数据中因节点间复杂关系而更显著。现有方法依赖本地模型输出计算子图间相似度,但其结果不可靠,且忽略子图内部存在的关键异质性。为此,本文提出统一建模子图间与子图内异质性的新方法FedIIH。针对子图间关系,设计分层变分模型,以多层级形式推断子图数据整体分布,实现全局视角下的相似度精准刻画;针对子图内异质性,将子图解耦为多个潜在因子,并将模型参数对应划分至各因子,使学习到的表示对无关因素具有鲁棒性。实验在6个同质与5个异质图数据集(非重叠与重叠设置)上验证了方法有效性,相比9种先进方法,平均在异质数据集上提升5.79个百分点。
原文摘要 · Abstract (English)
Heterogeneity is a fundamental and challenging issue in federated learning, especially for the graph data due to the complex relationships among the graph nodes. To deal with the heterogeneity, lots of existing methods perform the weighted federation based on their calculated similarities between pairwise clients (i.e., subgraphs). However, their inter-subgraph similarities estimated with the outputs of local models are less reliable, because the final outputs of local models may not comprehensively represent the real distribution of subgraph data. In addition, they ignore the critical intra-heterogeneity which usually exists within each subgraph itself. To address these issues, we propose a novel Federated learning method by integrally modeling the Inter-Intra Heterogeneity (FedIIH). For the inter-subgraph relationship, we propose a novel hierarchical variational model to infer the whole distribution of subgraph data in a multi-level form, so that we can accurately characterize the inter-subgraph similarities with the global perspective. For the intra-heterogeneity, we disentangle the subgraph into multiple latent factors and partition the model parameters into multiple parts, where each part corresponds to a single latent factor. Our FedIIH not only properly computes the distribution similarities between subgraphs, but also learns disentangled representations that are robust to irrelevant factors within subgraphs, so that it successfully considers the inter- and intra- heterogeneity simultaneously. Extensive experiments on six homophilic and five heterophilic graph datasets in both non-overlapping and overlapping settings demonstrate the effectiveness of our method when compared with nine state-of-the-art methods. Specifically, FedIIH averagely outperforms the second-best method by a large margin of 5.79% on all heterophilic datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。