arXiv:2509.25977cs.LGcs.AI2025-09被引 1

用生成模型实现无数据持续学习,解决设备异构下的模型遗忘问题。

Data-Free Continual Learning of Server Models in Model-Heterogeneous Cloud-Device Collaboration

  • 用预训练扩散模型生成类特定原型,无需真实数据
  • 在多个数据集上提升模型泛化能力,有效缓解遗忘
  • 适合边缘设备模型异构的持续学习场景

云-设备协同计算推动了智能服务在分布式边缘设备上的部署,同时利用中心化云资源。在此范式下,联邦学习(FL)成为保护隐私的关键技术,避免原始数据从边缘设备传输至云端。然而,随着新数据持续涌现和模型多样性增加,传统联邦学习面临数据异构、模型异构和灾难性遗忘等固有问题,以及新的知识错位挑战。本文提出FedDCL框架,旨在实现模型异构环境下服务器模型的无数据持续学习。该框架利用预训练扩散模型提取轻量级类特定原型,具备三重无数据优势:(1)为当前任务生成合成数据以增强训练并缓解非独立同分布(non-IID)分布;(2)实现无示例的生成回放以保留过往任务知识;(3)实现异构设备到云端服务器的数据无感动态知识迁移。在多个数据集上的实验结果验证了其有效性,展现出在动态环境中提升联邦云-设备协作泛化性和实用性的潜力。

原文摘要 · Abstract (English)

The rise of cloud-device collaborative computing has enabled intelligent services to be delivered across distributed edge devices while leveraging centralized cloud resources. In this paradigm, federated learning (FL) has become a key enabler for privacy-preserving model training without transferring raw data from edge devices to the cloud. However, with the continuous emergence of new data and increasing model diversity, traditional federated learning faces significant challenges, including inherent issues of data heterogeneity, model heterogeneity and catastrophic forgetting, along with new challenge of knowledge misalignment. In this study, we introduce FedDCL, a novel framework designed to enable data-free continual learning of the server model in a model-heterogeneous federated setting. We leverage pre-trained diffusion models to extract lightweight class-specific prototypes, which confer a threefold data-free advantage, enabling: (1) generation of synthetic data for the current task to augment training and counteract non-IID data distributions; (2) exemplar-free generative replay for retaining knowledge from previous tasks; and (3) data-free dynamic knowledge transfer from heterogeneous devices to the cloud server.Experimental results on various datasets demonstrate the effectiveness of FedDCL, showcasing its potential to enhance the generalizability and practical applicability of federated cloud-device collaboration in dynamic settings.

联邦学习持续学习生成模型边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。