针对无线边缘网络,提出高效抗中断的去中心化联邦学习算法
Resilient Decentralized Wireless Federated Learning via Gradient Tracking with AdamW

- 结合梯度跟踪与自适应优化,缓解数据异构影响
- 双流量化+误差反馈,通信量降低40%以上且保持精度
- 适合资源受限的物联网设备,尤其在信号不稳场景下表现优
无线物联网边缘网络需要在本地数据异构和通信受限条件下可靠运行的去中心化学习方法。现有方案在严格时隙预算、信道衰落和丢包环境下常面临高通信开销和性能下降问题。本文提出QEF-GT-AdamW,一种面向无线通信网络的高效且抗中断的去中心化学习算法。该方法融合梯度跟踪以缓解非独立同分布数据影响,采用基于AdamW的自适应优化提升训练稳定性,并引入双流有偏量化与误差反馈机制,显著压缩模型与追踪信息的通信负载。为应对不可靠广播通信,系统在包未成功接收时启用本地回退策略。论文显式建模带宽、发射功率、时隙约束及信道衰落对学习性能的影响,建立了在压缩与不可靠无线通信下的收敛保证。在异构MNIST与CIFAR-10实验中,QEF-GT-AdamW持续优于代表性基线,在有限无线资源下实现更优的准确率-通信权衡。
原文摘要 · Abstract (English)
Wireless Internet-of-Things (IoT) edge networks require decentralized learning (DecL) methods that can operate reliably under both heterogeneous local data and communication-constrained wireless links. However, existing decentralized optimization schemes often incur substantial communication overhead and degraded performance when transmissions are constrained by strict airtime budgets, fading channels, and packet losses. This paper proposes QEF-GT-AdamW, a communication-efficient and outage-resilient algorithm for DecL over wireless communication (WCom) networks. The proposed method combines gradient tracking to mitigate the effect of non-IID data, AdamW-based adaptive optimization to improve training stability, and dual-stream biased quantization with error feedback to reduce communication payloads for both model and tracking exchanges. To address unreliable broadcast communication, the proposed framework further employs a local fallback strategy when scheduled packets are not successfully received. We explicitly model the effect of bandwidth, transmit power, airtime constraints, and fading channels on DecL performance, and establish convergence guarantees for the proposed algorithm under compressed and unreliable wireless communication. Experimental results on heterogeneous MNIST and CIFAR-10 settings show that QEF-GT-AdamW consistently improves robustness and convergence performance over representative DecL baselines while achieving favorable accuracy-communication trade-offs under limited wireless resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。