arXiv:2503.13180cs.LGcs.AI2025-03被引 4

提出新联邦学习框架,缓解数据异构下部分客户端参与时的漂移问题。

GC-Fed: Gradient Centralized Federated Learning with Partial Client Participation

  • 用超平面替代历史梯度作参考,避免参考点失真。
  • 局部与全局梯度集中机制结合,提升客户端对齐与训练稳定。
  • 在异构数据和部分参与场景下,准确率最高提升20%。

联邦学习(FL)支持隐私保护的多源信息融合(MSIF),但在高度异构数据设置下面临客户端漂移挑战。现有漂移缓解策略多依赖基于历史快照(如过去梯度或先前全局模型)的参考方法,当每轮仅部分客户端参与时,这些历史参考可能无法准确反映整体数据分布,导致训练不稳定。本文提出的梯度中心化联邦学习(GC-Fed)采用独立于历史的超平面作为参考点,指导本地训练并增强客户端间对齐。GC-Fed包含两个互补组件:局部梯度中心化(Local GC),在本地训练中集中梯度;全局梯度中心化(Global GC),在服务器聚合时集中更新。在混合设计中,Local GC用于特征提取层以调和客户端贡献,Global GC用于分类器层以稳定每轮性能。理论分析与基准任务上的大量实验表明,GC-Fed有效缓解客户端漂移,在异构与部分参与条件下准确率最高提升20%。

原文摘要 · Abstract (English)

Federated Learning (FL) enables privacy-preserving multi-source information fusion (MSIF) but is challenged by client drift in highly heterogeneous data settings. Many existing drift-mitigation strategies rely on reference-based techniques--such as gradient adjustments or proximal loss--that use historical snapshots (e.g., past gradients or previous global models) as reference points. When only a subset of clients participates in each training round, these historical references may not accurately capture the overall data distribution, leading to unstable training. In contrast, our proposed Gradient Centralized Federated Learning (GC-Fed) employs a hyperplane as a historically independent reference point to guide local training and enhance inter-client alignment. GC-Fed comprises two complementary components: Local GC, which centralizes gradients during local training, and Global GC, which centralizes updates during server aggregation. In our hybrid design, Local GC is applied to feature-extraction layers to harmonize client contributions, while Global GC refines classifier layers to stabilize round-wise performance. Theoretical analysis and extensive experiments on benchmark FL tasks demonstrate that GC-Fed effectively mitigates client drift and achieves up to a 20% improvement in accuracy under heterogeneous and partial participation conditions.

联邦学习梯度中心化异构数据客户端漂移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。