arXiv:2605.09356cs.LGcs.NI2026-05

提出函数空间ADMM方法,解决边缘设备非独立同分布数据下的联邦学习难题。

Function-Space ADMM for Decentralized Federated Learning: A Control Theoretic Perspective

论文配图:Function-Space ADMM for Decentralized Federated Learning: A Control Theoretic Perspective
图 1 · 摘自论文原文
  • 在函数空间利用ADMM更新,突破传统参数空间优化瓶颈。
  • 在单标签数据场景下收敛更快,准确率提升且设备间一致性更强。
  • 引入控制理论视角的稳定系数,增强极端非独立同分布下的鲁棒性。

去中心化联邦学习(FL)是训练传感器网络、物联网(IoT)设备等边缘系统上机器学习模型的有前景方法,其优势在于保护数据隐私,但常因设备间数据分布非独立同分布(non-IID)导致性能严重下降。传统方法直接优化模型参数,而神经网络训练本身非凸,标准凸优化收敛性不适用。本文提出联邦函数空间交替方向乘子法(FedF-ADMM),不再依赖参数空间,而是利用函数空间中损失泛函的凸性,推导出基于ADMM的更新方向,并通过知识蒸馏将其投影回参数空间。进一步引入稳定系数,从控制理论视角解释为比例-积分(PI)项,提升在极端非独立同分布条件下的鲁棒性。实验表明,在挑战性非独立同分布场景(如每台设备仅含单一标签数据)中,FedF-ADMM比现有去中心化FL方法收敛更快、更稳定,准确率更高,设备间一致性更好。

原文摘要 · Abstract (English)

Decentralized federated learning (FL) is a promising approach for training machine learning models on sensor networks, Internet of Things (IoT) devices, and other edge systems where no central server exists. While federated learning offers advantages such as preserving data privacy, it often suffers from non-independent and identically distributed (IID) data distributions across devices, which cause significant performance degradation. This issue is particularly severe when directly optimizing model parameters, because neural network training is inherently non-convex and standard convergence guarantees for convex optimization do not apply. Unlike existing decentralized FL methods that primarily operate in parameter space, we propose federated function-space alternating direction method of multipliers (FedF-ADMM). FedF-ADMM exploits the convexity of loss functionals within function space to derive alternating direction method of multipliers (ADMM)-based update directions, which are subsequently projected onto the parameter space via knowledge distillation. We further introduce a stabilization coefficient to enhance robustness under severe non-IID settings and analyze its behavior from a control-theoretic perspective by interpreting it as a proportional-integral (PI) term. Experiments under challenging non-IID scenarios, including settings where each device has data from only a single label, demonstrate that FedF-ADMM achieves faster and more stable convergence than existing decentralized FL methods, while attaining higher accuracy and better consensus among devices.

联邦学习去中心化非独立同分布控制理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。