arXiv:2511.16523cs.LG2025-11

提出首个动态参与联邦学习基准框架与知识池方案。

Dynamic Participation in Federated Learning: Benchmarks and a Knowledge Pool Plugin

  • 构建可配置的动态参与联邦学习评测平台
  • 发现主流模型在动态参与下性能显著下降
  • 知识池机制提升模型鲁棒性与泛化能力

联邦学习(FL)允许客户端分布式协同训练共享模型,但现有研究多假设客户端持续参与,忽视了实际中客户端可能间歇性加入或退出的动态参与(DPFL)场景。当前缺乏系统性的DPFL基准评估框架。本文首次提出开源的DPFL基准平台,支持可配置的数据分布、参与模式和评估指标。基于该平台,我们对四类主流FL模型进行评测,发现其在动态参与下出现显著性能下降。为此,我们提出通用插件式方案KPFL,通过跨活跃与闲置客户端共享知识池,结合双龄权重与数据偏置加权,辅以生成式知识蒸馏,缓解训练不稳定性并防止知识丢失。大量实验验证了动态参与对FL性能的显著影响,以及KPFL在提升模型鲁棒性和泛化能力方面的有效性。

原文摘要 · Abstract (English)

Federated learning (FL) enables clients to collaboratively train a shared model in a distributed manner, setting it apart from traditional deep learning paradigms. However, most existing FL research assumes consistent client participation, overlooking the practical scenario of dynamic participation (DPFL), where clients may intermittently join or leave during training. Moreover, no existing benchmarking framework systematically supports the study of DPFL-specific challenges. In this work, we present the first open-source framework explicitly designed for benchmarking FL models under dynamic client participation. Our framework provides configurable data distributions, participation patterns, and evaluation metrics tailored to DPFL scenarios. Using this platform, we benchmark four major categories of widely adopted FL models and uncover substantial performance degradation under dynamic participation. To address these challenges, we further propose Knowledge-Pool Federated Learning (KPFL), a generic plugin that maintains a shared knowledge pool across both active and idle clients. KPFL leverages dual-age and data-bias weighting, combined with generative knowledge distillation, to mitigate instability and prevent knowledge loss. Extensive experiments demonstrate the significant impact of dynamic participation on FL performance and the effectiveness of KPFL in improving model robustness and generalization.

联邦学习动态参与知识蒸馏模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。