解决异构图神经网络下的联邦学习难题,提升跨机构协作效果。
Knowledge-Driven Federated Graph Learning on Model Heterogeneity
- 每客户端部署轻量副驾驶模型,促进知识交互。
- 在8个数据集上平均提升3.88%准确率,异构与同构场景均有效。
- 适合多机构使用不同模型结构的隐私保护图学习任务。
联邦图学习(FGL)是一种有前景的协同图表示学习范式,允许多方在保护数据隐私的同时联合训练模型。然而,现有方法大多假设客户端模型同质,忽视了实际中常见的以模型为中心的异构联邦图学习(MHtFGL)问题——当组织使用不同规模和架构的图神经网络(GNN)时尤为突出。这种架构多样性不仅破坏了服务器端统一表示空间的聚合前提,还加剧了结构知识在客户端间的迁移与融合难度。为此,我们提出联邦图知识协同框架(FedGKC)。FedGKC 在每个客户端引入轻量级副驾驶模型,以支持异构本地架构下的知识交换,并采用两种互补机制:客户端侧自互知识蒸馏,通过多视角扰动实现本地模型与副驾驶模型间双向知识迁移;服务端侧知识感知模型聚合,基于客户端提供的知识动态分配聚合权重。在8个基准数据集上的大量实验表明,FedGKC 在异构场景下相较基线平均提升3.88%准确率,同时在同构设置中保持优异性能。
原文摘要 · Abstract (English)
Federated graph learning (FGL) has emerged as a promising paradigm for collaborative graph representation learning, enabling multiple parties to jointly train models while preserving data privacy. However, most existing approaches assume homogeneous client models and largely overlook the challenge of model-centric heterogeneous FGL (MHtFGL), which frequently arises in practice when organizations employ graph neural networks (GNNs) of different scales and architectures.Such architectural diversity not only undermines smooth server-side aggregation, which presupposes a unified representation space shared across clients' updates, but also further complicates the transfer and integration of structural knowledge across clients. To address this issue, we propose the Federated Graph Knowledge Collaboration (FedGKC) framework. FedGKC introduces a lightweight Copilot Model on each client to facilitate knowledge exchange while local architectures are heterogeneous across clients, and employs two complementary mechanisms: Client-side Self-Mutual Knowledge Distillation, which transfers effective knowledge between local and copilot models through bidirectional distillation with multi-view perturbation; and Server-side Knowledge-Aware Model Aggregation, which dynamically assigns aggregation weights based on knowledge provided by clients. Extensive experiments on eight benchmark datasets demonstrate that FedGKC achieves an average accuracy gain of 3.88% over baselines in MHtFGL scenarios, while maintaining excellent performance in homogeneous settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。