arXiv:2505.11304cs.LGcs.AI2025-05被引 5

解决联邦学习中通信与计算异构导致的模型偏差问题。

Heterogeneity-Aware Client Sampling for Optimal and Efficient Federated Learning

  • 提出新采样方法FedACS,动态适配客户端异构特性。
  • 理论证明可收敛至正确最优解,速度达O(1/√R)。
  • 实测性能提升4.3%-36%,通信减少22%-89%。

联邦学习(FL)中客户端普遍具有差异化的通信与计算能力。这种异构性会显著扭曲优化过程,导致目标不一致,使全局模型收敛至远离理想最优解的错误驻点。尽管影响重大,因通信与计算异构间交互的内在复杂性,其联合效应长期未被深入研究。本文首次对一般异构联邦学习进行统一理论分析,揭示了通信与计算异构驱动不一致性的根本机制。基于此,提出通用性方法FedACS,能消除所有类型的客观不一致。理论证明:即使在动态异构环境下,FedACS仍以O(1/√R)速率收敛至正确最优解。多数据集实验表明,相比现有最优及类别特定基线,FedACS性能提升4.3%-36%,通信开销降低22%-89%,计算负载减少14%-105%。

原文摘要 · Abstract (English)

Federated learning (FL) commonly involves clients with diverse communication and computational capabilities. Such heterogeneity can significantly distort the optimization dynamics and lead to objective inconsistency, where the global model converges to an incorrect stationary point potentially far from the pursued optimum. Despite its critical impact, the joint effect of communication and computation heterogeneity has remained largely unexplored, due to the intrinsic complexity of their interaction. In this paper, we reveal the fundamentally distinct mechanisms through which heterogeneous communication and computation drive inconsistency in FL. To the best of our knowledge, this is the first unified theoretical analysis of general heterogeneous FL, offering a principled understanding of how these two forms of heterogeneity jointly distort the optimization trajectory under arbitrary choices of local solvers. Motivated by these insights, we propose Federated Heterogeneity-Aware Client Sampling, FedACS, a universal method to eliminate all types of objective inconsistency. We theoretically prove that FedACS converges to the correct optimum at a rate of $O(1/\sqrt{R})$, even in dynamic heterogeneous environments. Extensive experiments across multiple datasets show that FedACS outperforms state-of-the-art and category-specific baselines by 4.3%-36%, while reducing communication costs by 22%-89% and computation loads by 14%-105%, respectively.

联邦学习异构采样优化收敛通信效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。