arXiv:2603.10763cs.LGcs.IT2026-03被引 1

通过优先传输梯度符号提升无线联邦学习性能

Prioritizing Gradient Sign Over Modulus: An Importance-Aware Framework for Wireless Federated Learning

  • 按重要性差异分层分配资源,优先传梯度符号
  • 在资源受限时测试准确率提升最高达9.96%
  • 适合边缘智能中通信资源紧张的场景

无线联邦学习(FL)支持在无线边缘实现人工智能模型的协同训练,以支撑无处不在的智能应用。然而,无线资源有限导致通信不可靠,成为主要挑战。为此,我们提出一种名为Sign-Prioritized FL(SP-FL)的新框架,通过不均等资源分配优先传输重要的梯度信息。具体地,认识到梯度方向在模型更新中的重要性,将梯度符号分包传输,并在模值未能正确恢复时复用符号进行梯度下降。为增强关键信息的传输可靠性,基于包级和设备级的重要性差异,构建分层资源分配问题,优化多设备间的带宽分配及符号与模值包之间的功率分配。为使问题可解,分析了SP-FL的一步收敛行为,显式刻画了两级数据重要性。进而采用牛顿-拉夫森法与逐次凸逼近(SCA)提出交替优化算法求解。仿真结果验证了SP-FL的优越性,尤其在资源受限场景下,于CIFAR-10数据集上测试准确率最高比现有方法提升9.96%。

原文摘要 · Abstract (English)

Wireless federated learning (FL) facilitates collaborative training of artificial intelligence (AI) models to support ubiquitous intelligent applications at the wireless edge. However, the inherent constraints of limited wireless resources inevitably lead to unreliable communication, which poses a significant challenge to wireless FL. To overcome this challenge, we propose Sign-Prioritized FL (SP-FL), a novel framework that improves wireless FL by prioritizing the transmission of important gradient information through uneven resource allocation. Specifically, recognizing the importance of descent direction in model updating, we transmit gradient signs in individual packets and allow their reuse for gradient descent if the remaining gradient modulus cannot be correctly recovered. To further improve the reliability of transmission of important information, we formulate a hierarchical resource allocation problem based on the importance disparity at both the packet and device levels, optimizing bandwidth allocation across multiple devices and power allocation between sign and modulus packets. To make the problem tractable, the one-step convergence behavior of SP-FL, which characterizes data importance at both levels in an explicit form, is analyzed. We then propose an alternating optimization algorithm to solve this problem using the Newton-Raphson method and successive convex approximation (SCA). Simulation results confirm the superiority of SP-FL, especially in resource-constrained scenarios, demonstrating up to 9.96\% higher testing accuracy on the CIFAR-10 dataset compared to existing methods.

联邦学习无线通信梯度压缩资源分配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。