arXiv:2411.02003cs.LGcs.AI2024-11被引 3

提出异构联邦图学习框架,解决任务与数据双重异构问题。

Against Multifaceted Graph Heterogeneity via Asymmetric Federated Prompt Learning

  • 分治框架分离通用与领域特定知识,支持不对称知识迁移。
  • 层级定向聚合器提升跨任务知识传递效率,准确率提升5.2%以上。
  • 虚拟提示图自动生成结构,增强数据效用,适合多场景联邦应用。

联邦图学习(FGL)旨在对不同任务的异构数据进行协作且私密的图模型优化。其核心挑战在于如何在应对多重图异构性的同时实现高效联邦优化以提升协同性能。现有方法主要关注图数据异构性,难以处理图任务异构性。为此,我们提出联邦图提示学习(FedGPL)框架,实现多重异构联邦参与方之间的基于提示的非对称图知识迁移。通过建立拆分式联邦框架,分别保留通用与领域特定图知识。设计两种算法:层次化定向传输聚合器(HiDTA)按方向可转移性逐层提炼跨任务有益知识;虚拟提示图(VPG)自适应生成图结构,通过识别主导子图并中和冗余部分来提升数据效用。理论分析与大量实验表明,相较于主流基线,在大规模联邦图数据集上,FedGPL显著提升了准确率与效率,性能提升达5.2%以上。

原文摘要 · Abstract (English)

Federated Graph Learning (FGL) aims to collaboratively and privately optimize graph models on divergent data for different tasks. A critical challenge in FGL is to enable effective yet efficient federated optimization against multifaceted graph heterogeneity to enhance mutual performance. However, existing FGL works primarily address graph data heterogeneity and perform incapable of graph task heterogeneity. To address the challenge, we propose a Federated Graph Prompt Learning (FedGPL) framework to efficiently enable prompt-based asymmetric graph knowledge transfer between multifaceted heterogeneous federated participants. Generally, we establish a split federated framework to preserve universal and domain-specific graph knowledge, respectively. Moreover, we develop two algorithms to eliminate task and data heterogeneity for advanced federated knowledge preservation. First, a Hierarchical Directed Transfer Aggregator (HiDTA) delivers cross-task beneficial knowledge that is hierarchically distilled according to the directional transferability. Second, a Virtual Prompt Graph (VPG) adaptively generates graph structures to enhance data utility by distinguishing dominant subgraphs and neutralizing redundant ones. We conduct theoretical analyses and extensive experiments to demonstrate the significant accuracy and efficiency effectiveness of FedGPL against multifaceted graph heterogeneity compared to state-of-the-art baselines on large-scale federated graph datasets.

联邦学习图神经网络异构性提示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。