arXiv:2602.18384cs.LGcs.AI2026-02被引 1

FedZMG通过零均值梯度正则化,高效缓解联邦学习中的客户端漂移问题。

FedZMG: Efficient Client-Side Optimization in Federated Learning

  • 将本地梯度投影到零均值超平面,无须调参或通信开销。
  • 在非独立同分布数据下,收敛速度和准确率显著优于FedAvg与FedAdam。
  • 适合资源受限的物联网设备,特别适用于数据异构性强的场景。

联邦学习(FL)可在边缘设备上实现分布式模型训练并保护数据隐私,但客户端数据常呈现非独立同分布(non-IID)特性,导致客户端漂移,降低收敛速度和模型性能。现有自适应优化器虽可缓解此问题,但往往引入计算复杂度或通信开销,不适用于资源受限的物联网环境。本文提出联邦零均值梯度(FedZMG),一种无参数、客户端侧优化算法,通过结构化正则化优化空间来应对客户端漂移。受梯度中心化启发,FedZMG将本地梯度投影至零均值超平面,有效消除异构数据分布带来的“强度”或“偏差”偏移,无需额外通信或超参数调优。理论分析表明,该方法可降低有效梯度方差,并保证比标准FedAvg更紧的收敛界。在EMNIST、CIFAR100和Shakespeare数据集上的大量实验表明,FedZMG在高度非IID设置下,相比基线方法FedAvg和自适应优化器FedAdam,实现了更快的收敛速度和更高的验证准确率。

原文摘要 · Abstract (English)

Federated Learning (FL) enables distributed model training on edge devices while preserving data privacy. However, clients tend to have non-Independent and Identically Distributed (non-IID) data, which often leads to client-drift, and therefore diminishing convergence speed and model performance. While adaptive optimizers have been proposed to mitigate these effects, they frequently introduce computational complexity or communication overhead unsuitable for resource-constrained IoT environments. This paper introduces Federated Zero Mean Gradients (FedZMG), a novel, parameter-free, client-side optimization algorithm designed to tackle client-drift by structurally regularizing the optimization space. Advancing the idea of Gradient Centralization, FedZMG projects local gradients onto a zero-mean hyperplane, effectively neutralizing the "intensity" or "bias" shifts inherent in heterogeneous data distributions without requiring additional communication or hyperparameter tuning. A theoretical analysis is provided, proving that FedZMG reduces the effective gradient variance and guarantees tighter convergence bounds compared to standard FedAvg. Extensive empirical evaluations on EMNIST, CIFAR100, and Shakespeare datasets demonstrate that FedZMG achieves better convergence speed and final validation accuracy compared to the baseline FedAvg and the adaptive optimizer FedAdam, particularly in highly non-IID settings.

联邦学习优化算法零均值非IID

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。