arXiv:2604.08617cs.LGcs.AI2026-04中稿 · ed

提出FEAT方法,提升联邦持续学习中样本回放的性能。

From Selection to Scheduling: Federated Geometry-Aware Correction Makes Exemplar Replay Work Better under Continual Dynamic Heterogeneity

  • 通过几何结构对齐,保持跨任务特征一致性。
  • 利用能量修正去除无关方向成分,增强对少数类敏感度。
  • 适合处理客户端和任务动态异构下的持续学习场景。

示例回放已成为缓解联邦持续学习(FCL)中灾难性遗忘的有效策略,通过保留过去任务的代表性样本。现有研究多关注样本重要性估计以识别信息丰富的样本,但通常忽略如何有效利用所选示例,这在客户端与任务间的持续动态异构下限制了性能。为此,本文提出一种联邦几何感知校正方法(FEAT),缓解因不平衡导致的表征坍缩问题,即稀有类别特征被拉向常见类别。该方法包含两个关键模块:1)几何结构对齐模块通过将特征表示间的成对角度相似性与固定共享的等角紧框架(Equiangular Tight Frame, ETF)原型对齐,实现结构化知识蒸馏,促进跨任务几何一致性,缓解表征漂移;2)基于能量的几何校正模块从特征嵌入中移除任务无关的方向成分,降低对多数类的预测偏差,提升对少数类的敏感度,增强模型在类别不平衡分布下的鲁棒性。

原文摘要 · Abstract (English)

Exemplar replay has become an effective strategy for mitigating catastrophic forgetting in federated continual learning (FCL) by retaining representative samples from past tasks. Existing studies focus on designing sample-importance estimation mechanisms to identify information-rich samples. However, they typically overlook strategies for effectively utilizing the selected exemplars, which limits their performance under continual dynamic heterogeneity across clients and tasks. To address this issue, this paper proposes a Federated gEometry-Aware correcTion method, termed FEAT, which alleviates imbalance-induced representation collapse that drags rare-class features toward frequent classes across clients. Specifically, it consists of two key modules: 1) the Geometric Structure Alignment module performs structural knowledge distillation by aligning the pairwise angular similarities between feature representations and their corresponding Equiangular Tight Frame prototypes, which are fixed and shared across clients to serve as a class-discriminative reference structure. This encourages geometric consistency across tasks and helps mitigate representation drift; 2) the Energy-based Geometric Correction module removes task-irrelevant directional components from feature embeddings, which reduces prediction bias toward majority classes. This improves sensitivity to minority classes and enhances the model's robustness under class-imbalanced distributions.

联邦学习持续学习几何校正类别不平衡

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。