arXiv:2604.15549cs.LGcs.DC2026-04

提出面向广播通信的去中心化联邦学习优化方法,加速收敛且不降低模型质量。

Optimizing Stochastic Gradient Push under Broadcast Communications

论文配图:Optimizing Stochastic Gradient Push under Broadcast Communications
图 1 · 摘自论文原文
  • 采用非对称混合矩阵设计,支持有向通信图,提升网络灵活性。
  • 实测表明收敛时间显著优于现有方法,模型精度无损失。
  • 适合无线环境下需高效通信的去中心化学习场景。

针对无线网络中广播通信下的去中心化联邦学习(DFL)收敛时间优化问题,聚焦混合矩阵设计。混合矩阵是影响迭代收敛速度与每轮通信开销的关键超参数,共同决定收敛时间。现有方法多基于对称双随机混合矩阵的分布式随机梯度下降(D-PSGD),限制通信图为无向图,缺乏灵活性。本文转向允许非对称矩阵的随机梯度推送(SGP),通过分析其收敛率与混合矩阵的关系,构建依赖图论参数的目标函数,并设计具备性能保障的高效算法。基于真实数据的评估显示,所提方案在不牺牲模型质量的前提下,显著缩短收敛时间。

原文摘要 · Abstract (English)

We consider the problem of minimizing the convergence time for decentralized federated learning (DFL) in wireless networks under broadcast communications, with focus on mixing matrix design. The mixing matrix is a critical hyperparameter for DFL that simultaneously controls the convergence rate across iterations and the communication demand per iteration, both strongly influencing the convergence time. Although the problem has been studied previously, existing solutions are mostly designed for decentralized parallel stochastic gradient descent (D-PSGD), which requires the mixing matrix to be symmetric and doubly stochastic. These constraints confine the activated communication graph to undirected (i.e., bidirected) graphs, which limits design flexibility. In contrast, we consider mixing matrix design for stochastic gradient push (SGP), which allows asymmetric mixing matrices and hence directed communication graphs. By analyzing how the convergence rate of SGP depends on the mixing matrices, we extract an objective function that explicitly depends on graph-theoretic parameters of the activated communication graph, based on which we develop an efficient design algorithm with performance guarantees. Our evaluations based on real data show that the proposed solution can notably reduce the convergence time compared to the state of the art without compromising the quality of the trained model.

联邦学习去中心化通信优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。