arXiv:2509.13895cs.LGcs.AI2025-09

通过参与率统计动态调节模型对齐,提升联邦学习稳定性与收敛速度。

FedSSG: Expectation-Gated and History-Aware Drift Alignment for Federated Learning

  • 基于客户端历史梯度差构建轻量记忆,结合预期参与率平滑门控更新
  • 在CIFAR-10/100上平均提升准确率0.9/2.7点,收敛速度提升4.5倍
  • 适合非独立同分布数据、部分设备参与的现实联邦场景

非独立同分布数据与部分参与导致联邦学习中客户端漂移和局部最优不一致,引发收敛不稳定与精度下降。本文提出FedSSG,一种基于随机采样引导、历史感知的漂移对齐方法。该方法为每个客户端维护一个漂移记忆,以轻量级形式累积本地模型差异;关键在于,通过观测/预期参与率的平滑函数(由服务器采样器生成的相位-期望信号)同时控制记忆更新与本地对齐项。这一统计基础的门控机制在采样噪声主导初期保持弱而平滑,待参与统计稳定后增强,有效缩小局部-全局差距,且无需额外通信。在含100/500客户端、2%-15%参与率的CIFAR-10/100基准测试中,FedSSG持续优于强基线,平均提升测试准确率约0.9(CIFAR-10)与2.7(CIFAR-100),平均加速目标精度收敛达4.5倍。该方法仅增加O(d)客户端内存与常数时间门控,在近似独立同分布或均匀采样下退化为温和正则化器。结果表明,采样统计可转化为有原则的历史感知阶段控制,以稳定并加速联邦训练。

原文摘要 · Abstract (English)

Non-IID data and partial participation induce client drift and inconsistent local optima in federated learning, causing unstable convergence and accuracy loss. We present FedSSG, a stochastic sampling-guided, history-aware drift alignment method. FedSSG maintains a per-client drift memory that accumulates local model differences as a lightweight sketch of historical gradients; crucially, it gates both the memory update and the local alignment term by a smooth function of the observed/expected participation ratio (a phase-by-expectation signal derived from the server sampler). This statistically grounded gate stays weak and smooth when sampling noise dominates early, then strengthens once participation statistics stabilize, contracting the local-global gap without extra communication. Across CIFAR-10/100 with 100/500 clients and 2-15 percent participation, FedSSG consistently outperforms strong drift-aware baselines and accelerates convergence; on our benchmarks it improves test accuracy by up to a few points (e.g., about +0.9 on CIFAR-10 and about +2.7 on CIFAR-100 on average over the top-2 baseline) and yields about 4.5x faster target-accuracy convergence on average. The method adds only O(d) client memory and a constant-time gate, and degrades gracefully to a mild regularizer under near-IID or uniform sampling. FedSSG shows that sampling statistics can be turned into a principled, history-aware phase control to stabilize and speed up federated training.

联邦学习模型漂移采样控制收敛加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。