arXiv:2505.23864cs.LGcs.AI2025-05NeurIPS

通过可学习投影向量实现个性化图联邦学习,不共享数据也能精准聚合

Personalized Subgraph Federated Learning with Differentiable Auxiliary Projections

  • 为每个客户端训练一个可微投影向量,将节点嵌入映射到一维空间
  • 用软排序与轻量卷积优化嵌入顺序,提升客户端间相似性度量精度
  • 投影向量作为紧凑签名,支持个性化模型生成且保留跨客户端知识

图结构数据上的联邦学习通常面临非独立同分布问题,尤其当各客户端持有的子图来自全局图时。本文提出联邦辅助投影(FedAux),一种个性化子图联邦学习框架,可在不共享原始数据或节点嵌入的前提下,对异构分布的本地模型进行对齐、比较与聚合。在FedAux中,每个客户端联合训练(i)一个局部GNN和(ii)一个可学习的辅助投影向量(APV),该向量将节点嵌入可微地投影至一维空间。随后通过软排序与轻量1D卷积在有序空间中精炼嵌入,使APV有效捕获客户端特有信息。本地训练后,这些APVs作为紧凑签名,由服务器计算客户端间相似性并进行相似性加权参数混合,生成个性化模型同时保持跨客户端知识传递。我们还提供了严格的理论分析以证明设计的收敛性与合理性。在多个图基准上的实证评估表明,FedAux在准确率与个性化性能上均显著优于现有基线。代码已公开于https://github.com/JhuoW/FedAux。

原文摘要 · Abstract (English)

Federated Learning (FL) on graph-structured data typically faces non-IID challenges, particularly in scenarios where each client holds a distinct subgraph sampled from a global graph. In this paper, we introduce Federated learning with Auxiliary projections (FedAux), a personalized subgraph FL framework that learns to align, compare, and aggregate heterogeneously distributed local models without sharing raw data or node embeddings. In FedAux, each client jointly trains (i) a local GNN and (ii) a learnable auxiliary projection vector (APV) that differentiably projects node embeddings onto a 1D space. A soft-sorting operation followed by a lightweight 1D convolution refines these embeddings in the ordered space, enabling the APV to effectively capture client-specific information. After local training, these APVs serve as compact signatures that the server uses to compute inter-client similarities and perform similarity-weighted parameter mixing, yielding personalized models while preserving cross-client knowledge transfer. Moreover, we provide rigorous theoretical analysis to establish the convergence and rationality of our design. Empirical evaluations across diverse graph benchmarks demonstrate that FedAux substantially outperforms existing baselines in both accuracy and personalization performance. The code is available at https://github.com/JhuoW/FedAux.

联邦学习图神经网络个性化可微投影

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。