arXiv:2411.11304cs.LG2024-11被引 2

单轮实现个性化图学习,解决异构客户端通信与偏差问题

Personalized One-shot Federated Graph Learning for Heterogeneous Clients

  • 单轮通信构建全局替代图,融合类别特征分布统计
  • 两阶段个性化训练平衡本地信息与全局知识,提升泛化能力
  • 兼容安全聚合,适合隐私敏感的异构图数据场景

联邦图学习(FGL)是打破分布式私有图数据孤岛的新兴范式。在异构图数据的实际场景中,个性化联邦图学习(pFGL)通过为客户端定制模型以提升模型效用。然而,现有pFGL方法在异构图上需大量通信轮次,导致显著通信开销与安全风险。单轮联邦学习(OFL)虽可实现单轮协作,但现有方法针对图像任务设计,对图数据无效,形成关键空白。此外,现有个性化模型存在偏差,难以有效泛化至少数类别。为此,我们提出首个面向节点分类的单轮个性化联邦图学习方法(O-pFGL),兼容安全聚合协议以保护隐私。具体地,为在单轮内实现有效图学习,该方法估计并聚合类别特征分布统计,于服务器端构建全局替代图,支持全局图模型训练。为缓解偏差,引入两阶段个性化训练机制,自适应平衡本地个人信息与来自替代图的全局洞察,同时提升个性化与泛化性能。在14个多样化真实世界图数据集上的大量实验表明,该方法在多种设置下显著优于现有最先进基线。

原文摘要 · Abstract (English)

Federated Graph Learning (FGL) has emerged as a promising paradigm for breaking data silos among distributed private graphs. In practical scenarios involving heterogeneous distributed graph data, personalized Federated Graph Learning (pFGL) aims to enhance model utility by training personalized models tailored to client needs. However, existing pFGL methods often require numerous communication rounds under heterogeneous graphs, leading to significant communication overhead and security concerns. While One-shot Federated Learning (OFL) enables collaboration in a single round, existing OFL methods are designed for image-centric tasks and are ineffective for graph data, leaving a critical gap in the field. Additionally, personalized models derived from existing methods suffer from bias, failing to effectively generalize to the minority. To address these challenges, we propose the first \textbf{O}ne-shot \textbf{p}ersonalized \textbf{F}ederated \textbf{G}raph \textbf{L}earning method (\textbf{O-pFGL}) for node classification, compatible with Secure Aggregation protocols for privacy preservation. Specifically, for effective graph learning in one communication round, our method estimates and aggregates class-wise feature distribution statistics to construct a global surrogate graph on the server, facilitating the training of a global graph model. To mitigate bias, we introduce a two-stage personalized training approach that adaptively balances local personal information and global insights from the surrogate graph, improving both personalization and generalization. Extensive experiments on 14 diverse real-world graph datasets demonstrate that our method significantly outperforms state-of-the-art baselines across various settings.

联邦学习图神经网络单轮学习个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。