arXiv:2602.15380cs.LG2026-02

用分数阶更新提升联邦学习收敛速度与稳定性

Fractional-Order Federated Learning

  • 引入分数阶随机梯度,利用历史信息增强模型记忆
  • 在多个非独立同分布数据集上测试,准确率更高且收敛更快
  • 适合研究分布式优化或处理异构数据的工程师和学者

联邦学习(FL)允许客户端在保护隐私的前提下协同训练全局模型。尽管具备隐私保护优势,传统FL存在收敛慢、通信开销高及数据非独立同分布(non-IID)等问题。本文提出一种新型FedAvg变体——分数阶联邦平均(FOFedAvg),结合分数阶随机梯度下降(FOSGD),捕捉长期依赖关系并挖掘深层历史信息。通过引入具有记忆感知的分数阶更新机制,FOFedAvg提升了通信效率,加速了收敛,并缓解了异构非IID数据带来的不稳定性。我们在包括MNIST、FEMNIST、CIFAR-10、CIFAR-100、EMNIST、Cleveland心病数据集、Sent140、PneumoniaMNIST和Edge-IIoTset在内的多个基准数据集上,对比了多种主流联邦优化算法。在不同非IID划分方案下,FOFedAvg在测试性能和收敛速度上均表现优异,多数情况下超越基线。理论上,我们证明了当分数阶参数满足 $0<α≤1$ 时,FOFedAvg在标准光滑性和有界方差假设下可收敛至平稳点。结果表明,分数阶、记忆感知的更新策略能显著提升联邦学习的鲁棒性与有效性,为异构数据下的分布式训练提供实用路径。

原文摘要 · Abstract (English)

Federated learning (FL) allows remote clients to train a global model collaboratively while protecting client privacy. Despite its privacy-preserving benefits, FL has significant drawbacks, including slow convergence, high communication cost, and non-independent-and-identically-distributed (non-IID) data. In this work, we present a novel FedAvg variation called Fractional-Order Federated Averaging (FOFedAvg), which incorporates Fractional-Order Stochastic Gradient Descent (FOSGD) to capture long-range relationships and deeper historical information. By introducing memory-aware fractional-order updates, FOFedAvg improves communication efficiency and accelerates convergence while mitigating instability caused by heterogeneous, non-IID client data. We compare FOFedAvg against a broad set of established federated optimization algorithms on benchmark datasets including MNIST, FEMNIST, CIFAR-10, CIFAR-100, EMNIST, the Cleveland heart disease dataset, Sent140, PneumoniaMNIST, and Edge-IIoTset. Across a range of non-IID partitioning schemes, FOFedAvg is competitive with, and often outperforms, these baselines in terms of test performance and convergence speed. On the theoretical side, we prove that FOFedAvg converges to a stationary point under standard smoothness and bounded-variance assumptions for fractional order $0<α\le 1$. Together, these results show that fractional-order, memory-aware updates can substantially improve the robustness and effectiveness of federated learning, offering a practical path toward distributed training on heterogeneous data.

联邦学习分数阶优化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。