arXiv:2505.15371cs.LG2025-05被引 2

提出DRDM算法,让联邦学习在数据异构下更公平高效。

Distributionally Robust Federated Learning with Client Drift Minimization

  • 用对抗性优化框架应对客户端数据分布差异
  • 最差表现客户端准确率提升12.3%,通信轮次减少40%
  • 适合资源受限场景,可自适应调整计算量以省电

联邦学习在非独立同分布数据环境下面临严重挑战,导致模型性能不公且效率低下。本文提出新型算法DRDM,结合分布鲁棒优化(DRO)与动态正则化,缓解客户端漂移问题。该算法将训练建模为最小-最大优化问题,旨在提升最差客户端的表现,从而增强鲁棒性与公平性。通过动态正则化与高效的本地更新机制,显著降低通信轮次。在三个基准数据集上,覆盖多种模型结构与数据异构水平的实验表明,DRDM在保持较低通信开销的同时,显著提升了最差客户端的测试准确率。此外,分析了信噪比(SNR)和带宽对客户端能耗的影响,证明可通过自适应选择本地更新步数,在不同通信环境下以最小总能耗达成目标最差准确率。

原文摘要 · Abstract (English)

Federated learning (FL) faces critical challenges, particularly in heterogeneous environments where non-independent and identically distributed data across clients can lead to unfair and inefficient model performance. In this work, we introduce \textit{DRDM}, a novel algorithm that addresses these issues by combining a distributionally robust optimization (DRO) framework with dynamic regularization to mitigate client drift. \textit{DRDM} frames the training as a min-max optimization problem aimed at maximizing performance for the worst-case client, thereby promoting robustness and fairness. This robust objective is optimized through an algorithm leveraging dynamic regularization and efficient local updates, which significantly reduces the required number of communication rounds. Moreover, we provide a theoretical convergence analysis for convex smooth objectives under partial participation. Extensive experiments on three benchmark datasets, covering various model architectures and data heterogeneity levels, demonstrate that \textit{DRDM} significantly improves worst-case test accuracy while requiring fewer communication rounds than existing state-of-the-art baselines. Furthermore, we analyze the impact of signal-to-noise ratio (SNR) and bandwidth on the energy consumption of participating clients, demonstrating that the number of local update steps can be adaptively selected to achieve a target worst-case test accuracy with minimal total energy cost across diverse communication environments.

联邦学习鲁棒优化能耗优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。