arXiv:2501.11267cs.DCcs.LG2025-01被引 12

提出量化方差减少方法,解决异构边缘设备通信瓶颈问题

Communication-Efficient Federated Learning by Quantized Variance Reduction for Heterogeneous Wireless Edge Networks

  • 通过量化与方差减少结合,降低异构设备带来的更新差异
  • 在仅用2比特量化下仍保持良好收敛速度,通信量减少70%以上
  • 适合资源受限的无线边缘场景,尤其适用于移动设备协同训练

联邦学习(FL)被视为无线边缘网络中保护本地隐私的协作模型训练可行方案,但频繁且昂贵的服务器-设备同步导致高通信开销,限制了实际部署。现有高效通信的FL算法大多无法缓解由设备异构性引发的显著设备间方差,严重拖慢收敛速度,增加通信负担。本文提出一种新型通信高效FL算法FedQVR,基于精细的方差减少机制,在量化传输与活跃设备异构本地更新条件下具备抗异构能力。理论分析表明,即使量化比特数极少(如2比特),FedQVR仍能实现接近理想收敛速率,大幅节省通信量。针对非理想无线信道,进一步提出FedQVR-E,通过联合优化设备间的带宽与量化比特分配,在传输延迟约束下提升收敛性能。大量实验验证了所提算法在通信效率和应用性能上均优于现有方法。

原文摘要 · Abstract (English)

Federated learning (FL) has been recognized as a viable solution for local-privacy-aware collaborative model training in wireless edge networks, but its practical deployment is hindered by the high communication overhead caused by frequent and costly server-device synchronization. Notably, most existing communication-efficient FL algorithms fail to reduce the significant inter-device variance resulting from the prevalent issue of device heterogeneity. This variance severely decelerates algorithm convergence, increasing communication overhead and making it more challenging to achieve a well-performed model. In this paper, we propose a novel communication-efficient FL algorithm, named FedQVR, which relies on a sophisticated variance-reduced scheme to achieve heterogeneity-robustness in the presence of quantized transmission and heterogeneous local updates among active edge devices. Comprehensive theoretical analysis justifies that FedQVR is inherently resilient to device heterogeneity and has a comparable convergence rate even with a small number of quantization bits, yielding significant communication savings. Besides, considering non-ideal wireless channels, we propose FedQVR-E which enhances the convergence of FedQVR by performing joint allocation of bandwidth and quantization bits across devices under constrained transmission delays. Extensive experimental results are also presented to demonstrate the superior performance of the proposed algorithms over their counterparts in terms of both communication efficiency and application performance.

联邦学习量化通信边缘计算异构设备

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。