解决分布式图数据持续学习中的遗忘与冲突问题
Federated Continual Graph Learning
- 本地保留关键节点,全局用伪原型重建知识
- 在多个图数据上实现更好新旧任务平衡
- 适合隐私敏感的跨机构图学习场景
管理动态演化的图数据面临存储和隐私挑战,训练图神经网络(GNN)时易出现灾难性遗忘,影响旧任务性能。尽管现有持续图学习(CGL)方法部分缓解此问题,但依赖集中式架构,忽视分布式图数据库的集体智能潜力。为此,我们提出联邦持续图学习(FCGL),在存储和隐私约束下适应多个演化图上的GNN。实证研究揭示两个核心挑战:局部图遗忘(LGF),客户端在适应新任务时丢失旧知识;全局专家冲突(GEC),服务器端参数聚合导致客户端知识不一致,使全局GNN在新旧任务上表现均不佳。为应对,我们提出POWER框架:本地通过最大局部-全局覆盖保留经验节点以缓解LGF;全局通过轨迹感知的知识迁移与伪原型重建解决GEC。在多种图数据集上的实验表明,POWER优于联邦化CGL基线及视觉导向的联邦持续学习方法。
原文摘要 · Abstract (English)
Managing evolving graph data presents substantial challenges in storage and privacy, and training graph neural networks (GNNs) on such data often leads to catastrophic forgetting, impairing performance on earlier tasks. Despite existing continual graph learning (CGL) methods mitigating this to some extent, they rely on centralized architectures and ignore the potential of distributed graph databases to leverage collective intelligence. To this end, we propose Federated Continual Graph Learning (FCGL) to adapt GNNs across multiple evolving graphs under storage and privacy constraints. Our empirical study highlights two core challenges: local graph forgetting (LGF), where clients lose prior knowledge when adapting to new tasks, and global expertise conflict (GEC), where the global GNN exhibits sub-optimal performance in both adapting to new tasks and retaining old ones, arising from inconsistent client expertise during server-side parameter aggregation. To address these, we introduce POWER, a framework that preserves experience nodes with maximum local-global coverage locally to mitigate LGF, and leverages pseudo-prototype reconstruction with trajectory-aware knowledge transfer to resolve GEC. Experiments on various graph datasets demonstrate POWER's superiority over federated adaptations of CGL baselines and vision-centric federated continual learning approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。