arXiv:2502.07059cs.LGcs.AI2025-02中稿 · publication in Neu…被引 39

解决分布式设备上持续学习的模型遗忘与数据异构难题

Federated Continual Learning: Concepts, Challenges, and Solutions

  • 融合联邦学习与持续学习,应对动态数据流
  • 提出缓解灾难性遗忘与非独立同分布数据的方法
  • 适合隐私敏感场景下的长期在线学习系统

联邦持续学习(FCL)作为一种在动态环境中协同模型训练的稳健方案,应对不断生成且分布于多设备的数据。本文综述了FCL的关键挑战,包括数据异构性、模型稳定性、通信开销和隐私保护。探讨了多种异构性形式及其对模型性能的影响,回顾了处理非独立同分布数据、资源受限平台及个性化学习的解决方案,揭示了异构数据分布带来的复杂性。进一步分析了确保模型稳定性和避免灾难性遗忘的技术,这些在非平稳环境中至关重要。同时,评估了隐私保护技术在FCL中的应用。本综述整合了联邦学习与持续学习的洞见,提出了提升FCL系统有效性与可扩展性的策略,使其适用于广泛的实际应用场景。

原文摘要 · Abstract (English)

Federated Continual Learning (FCL) has emerged as a robust solution for collaborative model training in dynamic environments, where data samples are continuously generated and distributed across multiple devices. This survey provides a comprehensive review of FCL, focusing on key challenges such as heterogeneity, model stability, communication overhead, and privacy preservation. We explore various forms of heterogeneity and their impact on model performance. Solutions to non-IID data, resource-constrained platforms, and personalized learning are reviewed in an effort to show the complexities of handling heterogeneous data distributions. Next, we review techniques for ensuring model stability and avoiding catastrophic forgetting, which are critical in non-stationary environments. Privacy-preserving techniques are another aspect of FCL that have been reviewed in this work. This survey has integrated insights from federated learning and continual learning to present strategies for improving the efficacy and scalability of FCL systems, making it applicable to a wide range of real-world scenarios.

联邦学习持续学习异构数据隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。