用预训练扩散模型生成数据,解决联邦学习中遗忘问题。
Diffusion-Driven Data Replay: A Novel Approach to Combat Forgetting in Federated Class Continual Learning
- 用预训练扩散模型逆向生成各类别数据,降低计算开销。
- 在多个数据集上准确率提升显著,最高达8.2%。
- 适合关注隐私保护下持续学习的科研与工业用户。
联邦类持续学习(FCCL)结合了分布式客户端学习与无缝适应新类别的需求,核心挑战是灾难性遗忘。由于隐私保护要求,传统经验回放方法不适用于FCCL。现有方法通过联邦训练GAN或无数据知识蒸馏生成历史数据,但存在生成器训练不稳定或生成质量低的问题。本文提出一种基于扩散模型的数据重放新方法:不训练扩散模型,而是利用预训练的条件扩散模型,在输入空间中搜索每类对应的输入条件,显著降低计算资源与时间成本,同时保证生成效果。此外,通过对比学习增强分类器在生成数据与真实数据上的域泛化能力,间接提升生成数据对真实数据的表征能力。大量实验表明,该方法显著优于现有基线,在多个数据集上性能提升最高达8.2%。代码已公开于https://github.com/jinglin-liang/DDDR。
原文摘要 · Abstract (English)
Federated Class Continual Learning (FCCL) merges the challenges of distributed client learning with the need for seamless adaptation to new classes without forgetting old ones. The key challenge in FCCL is catastrophic forgetting, an issue that has been explored to some extent in Continual Learning (CL). However, due to privacy preservation requirements, some conventional methods, such as experience replay, are not directly applicable to FCCL. Existing FCCL methods mitigate forgetting by generating historical data through federated training of GANs or data-free knowledge distillation. However, these approaches often suffer from unstable training of generators or low-quality generated data, limiting their guidance for the model. To address this challenge, we propose a novel method of data replay based on diffusion models. Instead of training a diffusion model, we employ a pre-trained conditional diffusion model to reverse-engineer each class, searching the corresponding input conditions for each class within the model's input space, significantly reducing computational resources and time consumption while ensuring effective generation. Furthermore, we enhance the classifier's domain generalization ability on generated and real data through contrastive learning, indirectly improving the representational capability of generated data for real data. Comprehensive experiments demonstrate that our method significantly outperforms existing baselines. Code is available at https://github.com/jinglin-liang/DDDR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。