arXiv:2510.26722cs.LGcs.AI2025-10被引 1

提出新型无线联邦学习方法,平衡偏差与方差提升收敛速度。

Non-Convex Over-the-Air Heterogeneous Federated Learning: A Bias-Variance Trade-off

  • 允许结构化恒定偏差,降低更新方差
  • 理论证明存在偏差-方差权衡,加速收敛
  • 适合非凸模型的异构无线环境应用

过空气(OTA)联邦学习通过无线多址信道的波形叠加实现单次传输聚合模型更新,具备可扩展性。现有设计通常假设无线条件同质(各设备路径损耗相同)或强制零偏差以保证收敛,但在异构无线场景下,此类方法受限于最弱设备,且放大更新方差。此外,以往对有偏OTA-FL的分析多集中于凸目标,而现代人工智能模型大多为非凸。针对这一空白,本文研究在无线异构条件下,基于随机梯度下降(SGD)的通用光滑非凸目标下的OTA-FL。提出新型OTA-FL SGD更新机制,允许结构化、时不变的模型偏差,同时降低更新方差。推导出有限时间平稳性界(期望时间平均梯度范数平方),明确揭示了偏差-方差权衡。为优化该权衡,构建非凸联合功率控制问题,并设计仅需基站统计信道状态信息(CSI)的高效逐次凸逼近(SCA)算法。在非凸图像分类任务上的实验验证了该方法:基于SCA的设计通过优化偏差加速收敛,并优于先前基线的泛化性能。

原文摘要 · Abstract (English)

Over-the-air (OTA) federated learning (FL) has been well recognized as a scalable paradigm that exploits the waveform superposition of the wireless multiple-access channel to aggregate model updates in a single use. Existing OTA-FL designs largely enforce zero-bias model updates by either assuming \emph{homogeneous} wireless conditions (equal path loss across devices) or forcing zero-bias updates to guarantee convergence. Under \emph{heterogeneous} wireless scenarios, however, such designs are constrained by the weakest device and inflate the update variance. Moreover, prior analyses of biased OTA-FL largely address convex objectives, while most modern AI models are highly non-convex. Motivated by these gaps, we study OTA-FL with stochastic gradient descent (SGD) for general smooth non-convex objectives under wireless heterogeneity. We develop novel OTA-FL SGD updates that allow a structured, time-invariant model bias while facilitating reduced variance updates. We derive a finite-time stationarity bound (expected time average squared gradient norm) that explicitly reveals a bias-variance trade-off. To optimize this trade-off, we pose a non-convex joint OTA power-control design and develop an efficient successive convex approximation (SCA) algorithm that requires only statistical CSI at the base station. Experiments on a non-convex image classification task validate the approach: the SCA-based design accelerates convergence via an optimized bias and improves generalization over prior OTA-FL baselines.

联邦学习无线通信非凸优化偏差方差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。