通过自适应量化提升无蜂窝网络中联邦学习的能效与速度
Accelerating Energy-Efficient Federated Learning in Cell-Free Networks with Adaptive Quantization
- 根据客户端状态动态调整梯度传输比特数,降低通信开销
- 在相同能耗和时延下,测试准确率最高提升19%
- 适合资源受限设备参与大规模联邦学习的场景
联邦学习(FL)使客户端共享学习参数而非本地数据,减少通信开销。传统无线网络在部署FL时面临延迟挑战。相比之下,无蜂窝大规模多输入多输出(CFmMIMO)可让多个客户端共享资源,提高频谱效率并降低大规模FL的延迟。然而,客户端通信资源受限可能阻碍FL训练完成。为此,我们提出一种能效高、低延迟的FL框架,优化上行链路功率分配以实现客户端与服务器的无缝协作。该框架采用自适应量化方案,动态调整本地梯度更新的比特分配以降低通信成本。我们构建联合优化问题,涵盖FL模型更新、本地迭代次数与功率分配,使用序列二次规划(SQP)求解,平衡能量与延迟。此外,客户端采用AdaDelta方法进行本地模型更新,相比标准SGD提升了局部模型收敛性,并对采用AdaDelta的FL收敛性进行了全面分析。数值结果表明,在相同能耗与延迟预算下,我们的功率分配方案相较Dinkelbach和最大和速率方法,测试准确率分别提升7%和19%;在三种功率分配方法中,所提量化方案相较AQUILA和LAQ,测试准确率分别提升36%和35%。
原文摘要 · Abstract (English)
Federated Learning (FL) enables clients to share learning parameters instead of local data, reducing communication overhead. Traditional wireless networks face latency challenges with FL. In contrast, Cell-Free Massive MIMO (CFmMIMO) can serve multiple clients on shared resources, boosting spectral efficiency and reducing latency for large-scale FL. However, clients' communication resource limitations can hinder the completion of the FL training. To address this challenge, we propose an energy-efficient, low-latency FL framework featuring optimized uplink power allocation for seamless client-server collaboration. Our framework employs an adaptive quantization scheme, dynamically adjusting bit allocation for local gradient updates to reduce communication costs. We formulate a joint optimization problem covering FL model updates, local iterations, and power allocation, solved using sequential quadratic programming (SQP) to balance energy and latency. Additionally, clients use the AdaDelta method for local FL model updates, enhancing local model convergence compared to standard SGD, and we provide a comprehensive analysis of FL convergence with AdaDelta local updates. Numerical results show that, within the same energy and latency budgets, our power allocation scheme outperforms the Dinkelbach and max-sum rate methods by increasing the test accuracy up to $7$\% and $19$\%, respectively. Moreover, for the three power allocation methods, our proposed quantization scheme outperforms AQUILA and LAQ by increasing test accuracy by up to $36$\% and $35$\%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。