arXiv:2505.10125cs.LG2025-05IJCAI

通过提升本地模型适应性,显著改善联邦学习全局模型性能。

Enhancing the Performance of Global Model by Improving the Adaptability of Local Models in Federated Learning

  • 引入本地模型适应性概念,优化其在异构数据上的泛化能力。
  • 在多个基准上实现全局模型性能超越基线方法。
  • 适合研究联邦学习中异构数据挑战的学者与工程师。

联邦学习允许客户端协作训练一个全局模型,该模型由本地模型聚合而成。由于客户端间数据分布异构及隐私限制,难以训练出高性能的本地模型以支撑全局模型。本文提出本地模型的适应性——即本地模型在各客户端数据分布上的平均表现,并通过提升适应性来增强全局模型性能。由于每个客户端无法知晓其他客户端的数据分布,适应性无法直接优化。本文首先揭示具有良好适应性的本地模型特性,将其形式化为带约束的本地训练目标,并提出可行的训练方案。大量实验表明,该方法显著提升了本地模型的适应性,所获全局模型性能持续优于基线方法。

原文摘要 · Abstract (English)

Federated learning enables the clients to collaboratively train a global model, which is aggregated from local models. Due to the heterogeneous data distributions over clients and data privacy in federated learning, it is difficult to train local models to achieve a well-performed global model. In this paper, we introduce the adaptability of local models, i.e., the average performance of local models on data distributions over clients, and enhance the performance of the global model by improving the adaptability of local models. Since each client does not know the data distributions over other clients, the adaptability of the local model cannot be directly optimized. First, we provide the property of an appropriate local model which has good adaptability on the data distributions over clients. Then, we formalize the property into the local training objective with a constraint and propose a feasible solution to train the local model. Extensive experiments on federated learning benchmarks demonstrate that our method significantly improves the adaptability of local models and achieves a well-performed global model that consistently outperforms the baseline methods.

联邦学习模型适应性异构数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。