提出抗噪声的无线联邦学习框架,提升异构网络下模型训练稳定性。
Noise Resilient Over-The-Air Federated Learning In Heterogeneous Wireless Networks
- 客户端使用带约束的近似优化,增强对延迟和异构的鲁棒性。
- 在真实数据集上实现更稳定收敛,准确率显著优于基线方法。
- 适合6G中存在噪声、延迟和设备差异的边缘联邦学习场景。
在6G无线网络中,人工智能驱动的应用需要采用联邦学习(FL)来实现跨分布式设备的高效且隐私保护的模型训练。过空气联邦学习(OTA-FL)利用多址信道的叠加特性,使6G网络中的边缘用户能高效共享频谱资源,并实现低延迟的全局模型聚合。然而,这些优势伴随着挑战:传统OTA-FL技术受服务器端加性高斯白噪声(AWGN)、信道衰落,以及参与设备的数据和系统异构性共同影响。本文提出新型抗噪声过空气联邦学习(NoROTA-FL)框架,以联合应对上述问题。在NoROTA-FL中,本地优化问题求解为受控的非精确解,表现为客户端的额外近端约束,从而增强对慢节点导致的部分工作、异构性、噪声和衰落的鲁棒性。理论上,我们利用零阶与一阶非精确性,建立了在异构数据和不同系统能力下非凸优化问题的收敛保证。实验上,我们在真实数据集FEMNIST、CIFAR10和CIFAR100上验证了NoROTA-FL,证明其在噪声和异构环境下的鲁棒性。相比当前先进方法如COTAF和FedProx,NoROTA-FL在存在慢节点时实现了更稳定的收敛和更高的准确率。
原文摘要 · Abstract (English)
In 6G wireless networks, Artificial Intelligence (AI)-driven applications demand the adoption of Federated Learning (FL) to enable efficient and privacy-preserving model training across distributed devices. Over-The-Air Federated Learning (OTA-FL) exploits the superposition property of multiple access channels, allowing edge users in 6G networks to efficiently share spectral resources and perform low-latency global model aggregation. However, these advantages come with challenges, as traditional OTA-FL techniques suffer due to the joint effects of Additive White Gaussian Noise (AWGN) at the server, fading, and both data and system heterogeneity at the participating edge devices. In this work, we propose the novel Noise Resilient Over-the-Air Federated Learning (NoROTA-FL) framework to jointly tackle these challenges in federated wireless networks. In NoROTA-FL, the local optimization problems find controlled inexact solutions, which manifests as an additional proximal constraint at the clients. This approach provides robustness against straggler-induced partial work, heterogeneity, noise, and fading. From a theoretical perspective, we leverage the zeroth- and first-order inexactness and establish convergence guarantees for non-convex optimization problems in the presence of heterogeneous data and varying system capabilities. Experimentally, we validate NoROTA-FL on real-world datasets, including FEMNIST, CIFAR10, and CIFAR100, demonstrating its robustness in noisy and heterogeneous environments. Compared to state-of-the-art baselines such as COTAF and FedProx, NoROTA-FL achieves significantly more stable convergence and higher accuracy, particularly in the presence of stragglers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。