arXiv:2509.23683cs.LG2025-09NeurIPS被引 1

提出动态协作框架,让客户端自主组队避免遗忘,提升个性化学习效果。

Decentralized Dynamic Cooperation of Personalized Models for Federated Continual Learning

  • 客户端按需组建动态合作联盟,避免无关知识干扰。
  • 新任务下非重叠联盟形成,显著缓解灾难性遗忘。
  • 适合异构数据场景,尤其适合长期持续学习的边缘设备。

联邦持续学习(FCL)因其支持分布式计算和适应动态数据分布而受到关注。但新任务的引入带来时间与跨客户端分布变化,导致灾难性遗忘问题突出。现有方法多将知识聚合到全局模型,可能因无关信息引入干扰,尤其在异构环境下影响客户端性能。直接采用去中心化方法时,任务变化导致合作群体形成低效。为此,本文提出去中心化动态协作框架(DCFCL),客户端通过动态建立协作联盟,在获取新知识与保留旧知识间取得平衡,实现个性化模型。每个客户端选择性协作,仅与能带来性能提升的伙伴结盟,形成各阶段互不重叠的可变联盟。利用联盟亲和博弈模拟客户端间关系,结合梯度一致性与模型相似性量化合作收益。同时提出合并阻断算法与动态演化算法,实现协作与演化的动态均衡。大量实验表明,该方法优于多种基线。代码已开源:https://github.com/ydn3229/DCFCL。

原文摘要 · Abstract (English)

Federated continual learning (FCL) has garnered increasing attention for its ability to support distributed computation in environments with evolving data distributions. However, the emergence of new tasks introduces both temporal and cross-client shifts, making catastrophic forgetting a critical challenge. Most existing works aggregate knowledge from clients into a global model, which may not enhance client performance since irrelevant knowledge could introduce interference, especially in heterogeneous scenarios. Additionally, directly applying decentralized approaches to FCL suffers from ineffective group formation caused by task changes. To address these challenges, we propose a decentralized dynamic cooperation framework for FCL, where clients establish dynamic cooperative learning coalitions to balance the acquisition of new knowledge and the retention of prior learning, thereby obtaining personalized models. To maximize model performance, each client engages in selective cooperation, dynamically allying with others who offer meaningful performance gains. This results in non-overlapping, variable coalitions at each stage of the task. Moreover, we use coalitional affinity game to simulate coalition relationships between clients. By assessing both client gradient coherence and model similarity, we quantify the client benefits derived from cooperation. We also propose a merge-blocking algorithm and a dynamic cooperative evolution algorithm to achieve cooperative and dynamic equilibrium. Comprehensive experiments demonstrate the superiority of our method compared to various baselines. Code is available at: https://github.com/ydn3229/DCFCL.

联邦学习持续学习动态协作个性化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。