解决联邦图模型中知识混淆问题,提升跨域适应能力。
Towards Effective Federated Graph Foundation Model via Mitigating Knowledge Entanglement
- 用全局锚点初始化确保各领域知识可区分,避免混合
- 客户端自适应提示池支持下游任务精准适配
- 在8个基准上超越20种基线方法,适合跨域图学习
图机器学习近年转向数据驱动范式,两大方向兴起:(1) 联邦图学习(FGL)支持多客户端协作,但受数据与任务异构性制约;(2) 图基础模型(GFM)具备强泛化能力,却通常单机训练,无法利用跨孤岛数据。二者互补,集成带来显著优势。为此,我们提出FedGFM,一种新型去中心化GFM训练范式。关键挑战在于知识纠缠——多领域知识融合为难以区分的表征,影响下游适应。为此,我们提出FedGFM+,包含两项核心模块:(1) AncDAI:基于全局锚点的域感知初始化策略。预训练前,各客户端将其本地图编码为域特定原型,作为语义锚点;围绕这些锚点生成合成嵌入以初始化全局模型。理论上证明原型在域间可区分,提供强归纳偏置以解耦域知识。(2) AdaDPP:本地自适应域敏感提示池。各客户端在预训练中学习轻量级图提示,捕捉域语义;微调时,所有客户端提示构成提示池,由GFM选择相关提示增强目标图属性,提升下游适应性。FedGFM+在8个跨领域、多任务基准上评估,优于20种监督学习、FGL及联邦GFM基线方法。
原文摘要 · Abstract (English)
Recent advances in graph machine learning have shifted to data-centric paradigms, driven by two emerging fields: (1) Federated graph learning (FGL) enables multi-client collaboration but faces challenges from data and task heterogeneity, limiting its practicality; (2) Graph foundation models (GFM) offer strong domain generalization but are usually trained on single machines, missing out on cross-silo data and resources. These paradigms are complementary, and their integration brings notable benefits. Motivated by this, we propose FedGFM, a novel decentralized GFM training paradigm. However, a key challenge is knowledge entanglement, where multi-domain knowledge merges into indistinguishable representations, hindering downstream adaptation. To address this, we present FedGFM+, an enhanced framework with two core modules to reduce knowledge entanglement: (1) AncDAI: A global anchor-based domain-aware initialization strategy. Before pre-training, each client encodes its local graph into domain-specific prototypes that serve as semantic anchors. Synthetic embeddings around these anchors initialize the global model. We theoretically prove these prototypes are distinguishable across domains, providing a strong inductive bias to disentangle domain-specific knowledge. (2) AdaDPP: A local adaptive domain-sensitive prompt pool. Each client learns a lightweight graph prompt capturing domain semantics during pre-training. During fine-tuning, prompts from all clients form a pool from which the GFM selects relevant prompts to augment target graph attributes, improving downstream adaptation. FedGFM+ is evaluated on 8 diverse benchmarks across multiple domains and tasks, outperforming 20 baselines from supervised learning, FGL, and federated GFM variants.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。