无需数据重放和任务标签,实现高效隐私保护的联邦持续学习
Task-Agnostic Federated Continual Learning via Replay-Free Gradient Projection
- 通过低秩特征基捕捉任务专属特征方向,共享全局子空间
- 投影更新至历史子空间正交补,有效缓解灾难性遗忘
- 推理时自动预测任务身份,支持无标签任务感知
联邦持续学习(FCL)允许分布式客户端在不回访过往数据的前提下,协作训练随时间到来的新任务。现有方法常面临灾难性遗忘问题,依赖可能违反隐私的数据重放缓冲区或生成模型,或需在推理时知晓任务身份。本文提出FedProTIP框架,一种无需重放的联邦持续学习方法,通过各客户端对中间激活使用随机奇异值分解提取低秩核心基,捕获当前任务的主要特征方向,并将这些基上传至服务器进行聚合,构建跨客户端共享的任务特征子空间。训练时,客户端更新被投影到先前学习子空间的正交补空间中,以减少跨任务干扰并缓解遗忘。同时,学习到的子空间在推理阶段用于通过子空间相关性估计任务身份,实现无需显式任务标签的任务无关预测。在CIFAR100、ImageNet-R和DomainNet上的实验表明,FedProTIP持续优于最先进的联邦持续学习基线,且具有更低的训练时间、内存占用和通信开销。
原文摘要 · Abstract (English)
Federated continual learning (FCL) enables collaborative model training across distributed clients on sequentially arriving tasks without revisiting past data. However, existing approaches often suffer from catastrophic forgetting, rely on replay buffers or generative models that may violate privacy constraints, or assume knowledge of task identities during inference. We propose FedProTIP (Federated Projection-based Continual Learning with Task Identity Prediction), a replay-free FCL framework that maintains shared task-specific feature subspaces across clients. Each client extracts low-rank core bases from intermediate activations using randomized singular value decomposition, capturing dominant feature directions associated with the current task. These bases are transmitted to the server and aggregated to construct global task subspaces that capture shared feature directions across clients without requiring data sharing. During training, client updates are projected onto the orthogonal complement of previously learned subspaces to reduce cross-task interference and mitigate catastrophic forgetting. The learned subspaces are also reused during inference to estimate task identity via subspace relevance, enabling task-agnostic prediction without requiring explicit task labels. Experiments on CIFAR100, ImageNet-R, and DomainNet demonstrate that FedProTIP consistently outperforms state-of-the-art federated continual learning baselines while maintaining lower training time, memory footprint, and communication cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。