arXiv:2503.20808cs.LGcs.CV2025-03

针对医疗联邦持续学习中任务动态变化导致的遗忘与优化偏差,提出自适应重校准的动态分配超网络。

Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for Federated Continual Learning

  • 设计动态分配超网络,按任务身份实时分配模型参数,缓解遗忘问题。
  • 引入自适应模型重校准机制,融合历史模型变化,提升跨时间步任务优化一致性。
  • 适用于任务流异步、动态变化的医疗联邦学习场景,尤其适合多中心临床数据协同。

联邦持续学习(FCL)为真实世界场景下的联邦学习提供了新范式,尤其在医疗领域中,客户端的任务随时间动态且异步演化。现有服务器端FCL方法在自然域中通过聚合所有参与任务来构建可持续学习的服务器模型,但面临两大挑战:(1)先前任务的灾难性遗忘导致服务器模型错误累积,难以维持全任务知识;(2)因不同客户端处理异步任务,导致同一时间步优化目标冲突,引发优化偏差。本文首次在医疗领域提出一种新型服务器端FCL框架——动态分配超网络与自适应模型重校准(FedDAH)。通过设计持续更新的动态分配超网络(DAHyper),实现任务身份到模型参数的动态映射,支持客户端间模型的灵活分配。针对优化偏差,提出自适应模型重校准(AMR),将历史模型候选变化融入当前服务器更新,并基于相似性为不同时段的相同任务分配权重,实现持续优化。在AMOS数据集上的大量实验表明,所提方法在具有不同任务流的站点上显著优于其他FCL方法。代码已开源:https://github.com/jinlab-imvr/FedDAH。

原文摘要 · Abstract (English)

Federated continual learning (FCL) offers an emerging pattern to facilitate the applicability of federated learning (FL) in real-world scenarios, where tasks evolve dynamically and asynchronously across clients, especially in medical scenario. Existing server-side FCL methods in nature domain construct a continually learnable server model by client aggregation on all-involved tasks. However, they are challenged by: (1) Catastrophic forgetting for previously learned tasks, leading to error accumulation in server model, making it difficult to sustain comprehensive knowledge across all tasks. (2) Biased optimization due to asynchronous tasks handled across different clients, leading to the collision of optimization targets of different clients at the same time steps. In this work, we take the first step to propose a novel server-side FCL pattern in medical domain, Dynamic Allocation Hypernetwork with adaptive model recalibration (FedDAH). It is to facilitate collaborative learning under the distinct and dynamic task streams across clients. To alleviate the catastrophic forgetting, we propose a dynamic allocation hypernetwork (DAHyper) where a continually updated hypernetwork is designed to manage the mapping between task identities and their associated model parameters, enabling the dynamic allocation of the model across clients. For the biased optimization, we introduce a novel adaptive model recalibration (AMR) to incorporate the candidate changes of historical models into current server updates, and assign weights to identical tasks across different time steps based on the similarity for continual optimization. Extensive experiments on the AMOS dataset demonstrate the superiority of our FedDAH to other FCL methods on sites with different task streams. The code is available:https://github.com/jinlab-imvr/FedDAH.

联邦学习持续学习医疗AI模型重校准

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。