arXiv:2511.19851cs.LGcs.DC2025-11被引 1

混合学习模式加速无线分布式训练,兼顾速度与精度。

Accelerating Wireless Distributed Learning via Hybrid Split and Federated Learning Optimization

  • 分阶段调度设备用联邦或分割学习模式协同训练
  • 优化后收敛速度比现有方法快40%以上
  • 适合资源受限的移动边缘计算场景

联邦学习(FL)和分割学习(SL)是无线网络中两种有效的分布式学习范式,可在不共享原始数据的情况下实现移动设备间的协同模型训练。虽然FL支持低延迟并行训练,但可能收敛到精度较低的模型;而SL通过串行训练获得更高精度,但延迟增加。为结合两者优势,混合分割与联邦学习(HSFL)允许部分设备采用FL模式,其余设备采用SL模式。本文旨在加速HSFL,解决三个关键问题:1)学习模式选择如何影响整体性能?2)它如何与批量大小交互?3)如何联合优化超参数、通信与计算资源以减少总学习延迟?我们首先分析收敛性,揭示学习模式与批量大小的相互作用。随后构建延迟最小化问题,提出两阶段求解方案:先用块坐标下降法求解松弛问题得到局部最优解,再通过舍入算法恢复整数批量大小,实现近优性能。实验结果表明,该方法显著加速达到目标精度的收敛速度,优于现有方法。

原文摘要 · Abstract (English)

Federated learning (FL) and split learning (SL) are two effective distributed learning paradigms in wireless networks, enabling collaborative model training across mobile devices without sharing raw data. While FL supports low-latency parallel training, it may converge to less accurate model. In contrast, SL achieves higher accuracy through sequential training but suffers from increased delay. To leverage the advantages of both, hybrid split and federated learning (HSFL) allows some devices to operate in FL mode and others in SL mode. This paper aims to accelerate HSFL by addressing three key questions: 1) How does learning mode selection affect overall learning performance? 2) How does it interact with batch size? 3) How can these hyperparameters be jointly optimized alongside communication and computational resources to reduce overall learning delay? We first analyze convergence, revealing the interplay between learning mode and batch size. Next, we formulate a delay minimization problem and propose a two-stage solution: a block coordinate descent method for a relaxed problem to obtain a locally optimal solution, followed by a rounding algorithm to recover integer batch sizes with near-optimal performance. Experimental results demonstrate that our approach significantly accelerates convergence to the target accuracy compared to existing methods.

联邦学习分布式训练优化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。