arXiv:2510.24503cs.LGcs.AI2025-10

对比个性化联邦学习的本地性能与分布外泛化能力,发现主流方法存在权衡缺陷。

Local Performance vs. Out-of-Distribution Generalization: An Empirical Analysis of Personalized Federated Learning in Heterogeneous Data Environments

  • 提出FLIU算法,在FedAvg基础上加入自适应个性化更新
  • 在非独立同分布数据下,本地性能提升但分布外泛化能力下降
  • 首次系统评估通信轮次内不同阶段的表现差异,适合关注鲁棒性的研究者

在数据异构的联邦学习中,本地模型训练易收敛至各自局部最优,导致聚合后全局模型偏离整体分布(客户端漂移),使多数客户端性能不佳。现有个性化联邦学习仅关注本地平均性能,忽视了对分布外样本的泛化能力——而这是FedAvg的重要优势。本研究系统评估多种联邦学习方法的本地性能与泛化能力。通过分析单轮通信内的多个阶段,揭示指标变化动态。提出改进算法FLIU,引入自适应个性化因子,在MNIST和CIFAR-10上测试,涵盖基准独立同分布(IID)与病理非独立同分布(non-IID),以及针对复杂异构性设计的狄利克雷分布新测试环境。

原文摘要 · Abstract (English)

In the context of Federated Learning with heterogeneous data environments, local models tend to converge to their own local model optima during local training steps, deviating from the overall data distributions. Aggregation of these local updates, e.g., with FedAvg, often does not align with the global model optimum (client drift), resulting in an update that is suboptimal for most clients. Personalized Federated Learning approaches address this challenge by exclusively focusing on the average local performances of clients' models on their own data distribution. Generalization to out-of-distribution samples, which is a substantial benefit of FedAvg and represents a significant component of robustness, appears to be inadequately incorporated into the assessment and evaluation processes. This study involves a thorough evaluation of Federated Learning approaches, encompassing both their local performance and their generalization capabilities. Therefore, we examine different stages within a single communication round to enable a more nuanced understanding of the considered metrics. Furthermore, we propose and incorporate a modified approach of FedAvg, designated as Federated Learning with Individualized Updates (FLIU), extending the algorithm by a straightforward individualization step with an adaptive personalization factor. We evaluate and compare the approaches empirically using MNIST and CIFAR-10 under various distributional conditions, including benchmark IID and pathological non-IID, as well as additional novel test environments with Dirichlet distribution specifically developed to stress the algorithms on complex data heterogeneity.

联邦学习个性化分布外泛化数据异构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。