让无线聚合更抗干扰,提升联邦学习通信效率
Learned Digital Codes for Over-the-Air Computation in Federated Edge Learning
- 用可学习的数字编码+端到端训练解码器,实现高效无线聚合
- 在低于10 dB信噪比下仍稳定运行,比现有方法多10 dB鲁棒性
- 适合高异构设备、弱信号环境下的联邦学习场景
联邦边缘学习(FEEL)使无线设备无需共享原始数据即可协同训练中心模型,但模型更新的多次上行传输导致通信成为主要瓶颈。过空气(OTA)聚合通过利用无线信道的叠加特性,实现通信与计算的并行融合。数字OTA方案结合传统数字通信的鲁棒性,但现有设计在低信噪比(SNR)条件下表现受限。本文提出一种可学习的数字OTA框架,在保持与先进方法相同上行开销的前提下,显著提升恢复精度、收敛性能和低SNR下的鲁棒性。该设计融合无源随机接入(URA)码本、向量量化与端到端训练的AMP-DA-Net解码器(基于未展开的近似消息传递结构),可将OTA聚合从平均扩展至包括截尾均值和多数表决在内的广义对称函数。在高度异构设备数据集和不同活跃设备数量下的实验表明,该方法将可靠数字OTA操作范围拓展至超过10 dB的低信噪比区域,且在整个信噪比范围内性能持平或超越现有方法。所提解码器在消息损坏和非线性聚合下仍有效,凸显端到端学习设计在数字OTA通信中的广阔潜力。
原文摘要 · Abstract (English)
Federated edge learning (FEEL) enables wireless devices to collaboratively train a centralised model without sharing raw data, but repeated uplink transmission of model updates makes communication the dominant bottleneck. Over-the-air (OTA) aggregation alleviates this by exploiting the superposition property of the wireless channel, enabling simultaneous transmission and merging communication with computation. Digital OTA schemes extend this principle by incorporating the robustness of conventional digital communication, but current designs remain limited in low signal-to-noise ratio (SNR) regimes. This work proposes a learned digital OTA framework that improves recovery accuracy, convergence behaviour, and robustness to challenging SNR conditions while maintaining the same uplink overhead as state-of-the-art methods. The design integrates an unsourced random access (URA) codebook with vector quantisation and AMP-DA-Net, an unrolled approximate message passing (AMP)-style decoder trained end-to-end with the digital codebook and parameter server local training statistics. The proposed design extends OTA aggregation beyond averaging to a broad class of symmetric functions, including trimmed means and majority-based rules. Experiments on highly heterogeneous device datasets and varying numbers of active devices show that the proposed design extends reliable digital OTA operation by more than 10 dB into low SNR regimes while matching or improving performance across the full SNR range. The learned decoder remains effective under message corruption and nonlinear aggregation, highlighting the broader potential of end-to-end learned design for digital OTA communication in FEEL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。