提出时空统计聚合方法,解决联邦增量学习中的数据异构与通信开销问题。
Enhancing Federated Class-Incremental Learning via Spatial-Temporal Statistics Aggregation
- 通过跨客户端和阶段的特征统计聚合,统一更新分类器。
- 在三个数据集上优于现有方法,准确率提升3.2%~5.1%。
- 支持低通信开销,适合资源受限的分布式场景。
联邦增量学习(FCIL)使分布式数据上的增量学习成为可能。现有方法通常将旧知识保留融入本地训练,但难以避免由数据异构性引发的时空客户端漂移,且常伴随显著的计算与通信开销,限制实际部署。为此,我们提出一种新方法——时空统计聚合(STSA),提供统一框架,同时在空间上(跨客户端)和时间上(跨阶段)聚合特征统计。聚合后的统计量不受数据异构影响,可在每个阶段闭式更新分类器。此外,我们引入通信高效的变体STSA-E,具有理论保证,在性能接近STSA的同时大幅降低通信开销。在三个广泛使用的FCIL数据集上,以不同数据异构程度进行的大量实验表明,该方法在性能、灵活性以及通信与计算效率方面均优于当前最优方法。代码已公开于 https://github.com/Yuqin-G/STSA。
原文摘要 · Abstract (English)
Federated Class-Incremental Learning (FCIL) enables Class-Incremental Learning (CIL) from distributed data. Existing FCIL methods typically integrate old knowledge preservation into local client training. However, these methods cannot avoid spatial-temporal client drift caused by data heterogeneity and often incur significant computational and communication overhead, limiting practical deployment. To address these challenges simultaneously, we propose a novel approach, Spatial-Temporal Statistics Aggregation (STSA), which provides a unified framework to aggregate feature statistics both spatially (across clients) and temporally (across stages). The aggregated feature statistics are unaffected by data heterogeneity and can be used to update the classifier in closed form at each stage. Additionally, we introduce STSA-E, a communication-efficient variant with theoretical guarantees, achieving similar performance to STSA-E with much lower communication overhead. Extensive experiments on three widely used FCIL datasets, with varying degrees of data heterogeneity, show that our method outperforms state-of-the-art FCIL methods in terms of performance, flexibility, and both communication and computation efficiency. The code is available at https://github.com/Yuqin-G/STSA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。