arXiv:2607.19384cs.LG2026-07中稿 · ECCV

提出统一几何手术框架,解决联邦持续学习中的时空遗忘问题。

SUM: Unified Geometric Surgery on Spatio-Temporal Adaptation Vectors for Federated Class Incremental Learning

论文配图:SUM: Unified Geometric Surgery on Spatio-Temporal Adaptation Vectors for Federated Class Incremental Learning
图 1 · 摘自论文原文
  • 将客户端与任务更新统一为共享空间的适应向量,从几何角度调控
  • 在聚合阶段实现无额外开销的时空干扰消除,提升22%性能
  • 纯服务器端设计,适合资源受限场景下的持续学习应用

现实智能系统常需在数据隔离的客户端间协同并持续适应新任务。这自然催生了联邦类增量学习(FCIL),融合了联邦学习(FL)与持续学习(CL)。然而两者结合带来双重干扰:客户端异构性引发的空间干扰,以及任务序列带来的时间干扰,共同导致时空灾难性遗忘(ST-CF)。现有方法通常分别处理两类干扰,常增加客户端计算或通信开销,且未规范聚合过程中的更新方向交互。本文将FCIL重新视为统一多任务学习问题,将客户端与任务更新均表示为共享参数空间中的适应向量。基于此,提出统一时空适应向量几何手术(SUM),一种纯服务器端框架,在聚合阶段对适应向量进行几何手术。空间版SUM在每轮内缓解客户端干扰,因果在线时间版SUM无额外开销地消除跨任务干扰。实验表明,SUM在多个视觉与语言基准上相比先前方法最高提升22%,且对不可靠客户端鲁棒,保持高效计算。

原文摘要 · Abstract (English)

Real-world intelligent systems often require both distributed collaboration across data-isolated clients and continual adaptation to evolving tasks. This setting naturally gives rise to Federated Class Incremental Learning (FCIL), which combines Federated Learning (FL) and Continual Learning (CL). However, their combination introduces two coupled sources of interference: spatial interference from heterogeneous clients and temporal interference from sequential tasks, jointly leading to Spatial-Temporal Catastrophic Forgetting (ST-CF). Existing approaches typically address spatial and temporal interference with separate mechanisms, often incurring additional client-side computation or communication, while leaving directional interactions among updates during aggregation unregulated. In this paper, we reinterpret FCIL as a unified multi-task learning problem, where both client and task updates are represented as adaptation vectors in a shared parameter space. Based on this view, we propose Unified Geometric Surgery on Spatio-Temporal Adaptation Vectors (SUM), a purely server-side framework that performs geometric surgery on adaptation vectors during aggregation. Spatial SUM mitigates client-level interference within each round, while causal online temporal SUM removes cross-task interference over time without additional client-side computation, communication, or memory beyond standard federated training. Empirically, SUM achieves up to 22% improvement over prior FCIL methods across diverse vision and language benchmarks while remaining robust to unreliable clients and maintaining computational efficiency.

联邦学习持续学习几何手术增量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。