arXiv:2412.10878cs.LGcs.NI2024-12被引 4

通过自适应量化与功率控制,显著降低联邦学习通信开销。

Adaptive Quantization Resolution and Power Control for Federated Learning over Cell-free Networks

  • 按重要性分层量化梯度,仅关键部分高精度传输
  • 动态调整用户发射功率,缓解慢速用户影响
  • 在延迟约束下比现有方法少93%通信量,精度更高

联邦学习(FL)是一种分布式学习框架,用户通过交换本地模型更新而非原始数据来训练全局模型,保护数据隐私并减少通信开销。然而,在传统无线网络中,随着用户数量和模型规模增加,延迟急剧上升。无蜂窝大规模多输入多输出(CFmMIMO)可通过空间复用在同一时频资源上服务大量用户,显著降低上行链路延迟。但该架构未考虑应用特性。本文将物理层与联邦学习应用协同优化,以缓解慢速用户问题。提出一种新型自适应混合分辨率量化方案,仅对最核心的梯度分量使用高精度。随后设计动态上行功率控制策略,管理不同用户速率变化。数值结果表明,所提方法在CIFAR-10、CIFAR-100和Fashion-MNIST数据集上实现与经典FL相当的测试精度,通信开销至少降低93%。相比AQUILA、Top-q和LAQ方法,在最大总延迟约束下,通信开销减少75%,测试精度提升10%。

原文摘要 · Abstract (English)

Federated learning (FL) is a distributed learning framework where users train a global model by exchanging local model updates with a server instead of raw datasets, preserving data privacy and reducing communication overhead. However, the latency grows with the number of users and the model size, impeding the successful FL over traditional wireless networks with orthogonal access. Cell-free massive multiple-input multipleoutput (CFmMIMO) is a promising solution to serve numerous users on the same time/frequency resource with similar rates. This architecture greatly reduces uplink latency through spatial multiplexing but does not take application characteristics into account. In this paper, we co-optimize the physical layer with the FL application to mitigate the straggler effect. We introduce a novel adaptive mixed-resolution quantization scheme of the local gradient vector updates, where only the most essential entries are given high resolution. Thereafter, we propose a dynamic uplink power control scheme to manage the varying user rates and mitigate the straggler effect. The numerical results demonstrate that the proposed method achieves test accuracy comparable to classic FL while reducing communication overhead by at least 93% on the CIFAR-10, CIFAR-100, and Fashion-MNIST datasets. We compare our methods against AQUILA, Top-q, and LAQ, using the max-sum rate and Dinkelbach power control schemes. Our approach reduces the communication overhead by 75% and achieves 10% higher test accuracy than these benchmarks within a constrained total latency budget.

联邦学习量化无蜂窝网络功率控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。