arXiv:2505.12245cs.LGcs.AI2025-05被引 4

提出无需梯度的联邦持续学习方法,解决数据异质性导致的遗忘问题。

AFCL: Analytic Federated Continual Learning for Spatio-Temporal Invariance of Non-IID Data

  • 基于冻结特征推导闭式解,实现单轮前向传播的本地训练
  • 全局聚合仅需单轮递归更新,显著降低计算开销
  • 理论证明对非IID数据具有时空不变性,适合分布式动态场景

联邦持续学习(FCL)使分布式客户端能在动态现实场景中协同训练全局模型。然而,现有方法面临客户端间空间数据异质性与在线任务间时间数据异质性的双重挑战,导致严重的时空灾难性遗忘。本文指出根本原因在于梯度对非IID数据的敏感性。为此,提出无梯度方法AFCL,通过冻结特征推导闭式解。本地训练中,每个客户端仅需单次前向传播即可完成学习;全局聚合时,服务器可单轮递归高效更新全局模型。理论分析表明,AFCL实现非IID数据的时空不变性,即无论数据在客户端和任务间如何异质,其聚合模型均等同于集中式联合学习结果。大量实验验证了其在多个基准数据集与设置下优于现有最先进方法。

原文摘要 · Abstract (English)

Federated Continual Learning (FCL) enables distributed clients to collaboratively train a global model from online task streams in dynamic real-world scenarios. However, existing FCL methods face challenges of both spatial data heterogeneity among distributed clients and temporal data heterogeneity across online tasks. Such data heterogeneity significantly degrades the model performance with severe spatial-temporal catastrophic forgetting of local and past knowledge. In this paper, we identify that the root cause of this issue lies in the inherent vulnerability and sensitivity of gradients to non-IID data. To fundamentally address this issue, we propose a gradient-free method, named Analytic Federated Continual Learning (AFCL), by deriving analytical (i.e., closed-form) solutions from frozen extracted features. In local training, our AFCL enables single-epoch learning with only a lightweight forward-propagation process for each client. In global aggregation, the server can recursively and efficiently update the global model with single-round aggregation. Theoretical analyses validate that our AFCL achieves spatio-temporal invariance of non-IID data. This ideal property implies that, regardless of how heterogeneous the data are distributed across local clients and online tasks, the aggregated model of our AFCL remains invariant and identical to that of centralized joint learning. Extensive experiments show the consistent superiority of our AFCL over state-of-the-art baselines across various benchmark datasets and settings.

联邦学习持续学习非IID时空不变

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。