arXiv:2503.18064cs.LGcs.CV2025-03被引 1

针对医疗联邦持续学习中任务动态演化导致的遗忘与优化偏差,提出新框架解决知识保持与协同优化问题。

Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for FCL

  • 设计动态分配超网络,按任务身份实时分配模型参数,缓解灾难性遗忘。
  • 引入自适应模型重校准机制,融合历史模型变化,提升跨时间步任务优化一致性。
  • 适用于任务流异步演化的医疗联邦学习场景,尤其适合多中心动态数据集。

联邦持续学习(FCL)为联邦学习在真实场景中的应用提供了新范式,尤其在医疗领域中,各客户端的任务随时间动态且异步演变。现有服务器端FCL方法在自然域中通过聚合所有参与任务的客户端模型来构建可持续学习的服务器模型,但面临两大挑战:(1) 针对先前任务的灾难性遗忘,导致服务器模型知识累积误差;(2) 由于不同客户端处理异步任务,造成同一时间步优化目标冲突。本文首次提出面向医疗领域的新型服务器端FCL范式——动态分配超网络与自适应模型重校准(FedDAH)。该方法通过动态分配超网络(DAHyper)实现任务身份到模型参数的动态映射,支持跨客户端的灵活模型分配;同时引入自适应模型重校准(AMR),将历史模型候选变化融入当前服务器更新,并基于相似性对不同时刻的相同任务赋予权重,实现持续优化。在AMOS数据集上的大量实验表明,所提方法在具有不同任务流的站点上显著优于其他FCL方法。代码已公开:https://github.com/jinlab-imvr/FedDAH。

原文摘要 · Abstract (English)

Federated continual learning (FCL) offers an emerging pattern to facilitate the applicability of federated learning (FL) in real-world scenarios, where tasks evolve dynamically and asynchronously across clients, especially in medical scenario. Existing server-side FCL methods in nature domain construct a continually learnable server model by client aggregation on all-involved tasks. However, they are challenged by: (1) Catastrophic forgetting for previously learned tasks, leading to error accumulation in server model, making it difficult to sustain comprehensive knowledge across all tasks. (2) Biased optimization due to asynchronous tasks handled across different clients, leading to the collision of optimization targets of different clients at the same time steps. In this work, we take the first step to propose a novel server-side FCL pattern in medical domain, Dynamic Allocation Hypernetwork with adaptive model recalibration (\textbf{FedDAH}). It is to facilitate collaborative learning under the distinct and dynamic task streams across clients. To alleviate the catastrophic forgetting, we propose a dynamic allocation hypernetwork (DAHyper) where a continually updated hypernetwork is designed to manage the mapping between task identities and their associated model parameters, enabling the dynamic allocation of the model across clients. For the biased optimization, we introduce a novel adaptive model recalibration (AMR) to incorporate the candidate changes of historical models into current server updates, and assign weights to identical tasks across different time steps based on the similarity for continual optimization. Extensive experiments on the AMOS dataset demonstrate the superiority of our FedDAH to other FCL methods on sites with different task streams. The code is available:https://github.com/jinlab-imvr/FedDAH.

联邦学习持续学习医疗AI模型重校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。