arXiv:2603.08687cs.LGcs.AI2026-03

提出新型分片联邦学习架构,兼顾高精度与低延迟。

Split Federated Learning Architectures for High-Accuracy and Low-Delay Model Training

  • 设计联合优化模型分片与客户端分配策略
  • 精度提升3%,延迟降低20%,通信量减少50%
  • 首个兼顾准确率与效率的启发式算法

能否找到一种网络架构,在分片联邦学习(SFL)中同时优化训练损失(从而提高准确率)并减少训练延迟与通信开销?尽管在传统先进SFL中模型分割方式不影响准确率,本文正面回答了上述问题。现有分层分片联邦学习(HSFL)采用客户端、本地聚合器和中心服务器的三层结构,将模型在两处分片层划分为三个子模型,分别在三端执行。然而,这类架构忽略了分片层位置及客户端到聚合器的分配对准确率、延迟和开销的影响。本文通过构建联合优化问题,显式建模这些因素的影响。我们证明该问题是NP-hard,并提出首个兼顾准确率的启发式算法,同时保持延迟效率。在公开数据集上的仿真结果表明,相比最先进的SFL和HSFL方案,本方法可提升准确率3%,降低延迟20%,减少通信开销50%。

原文摘要 · Abstract (English)

Can we find a network architecture for ML model training so as to optimize training loss (and thus, accuracy) in Split Federated Learning (SFL)? And can this architecture also reduce training delay and communication overhead? While accuracy is not influenced by how we split the model in ordinary, state-of-the-art SFL, in this work we answer the questions above in the affirmative. Recent Hierarchical SFL (HSFL) architectures adopt a three-tier training structure consisting of clients, (local) aggregators, and a central server. In this architecture, the model is partitioned at two partitioning layers into three sub-models, which are executed across the three tiers. Despite their merits, HSFL architectures overlook the impact of the partitioning layers and client-to-aggregator assignments on accuracy, delay, and overhead. This work explicitly captures the impact of the partitioning layers and client-to-aggregator assignments on accuracy, delay and overhead by formulating a joint optimization problem. We prove that the problem is NP-hard and propose the first accuracy-aware heuristic algorithm that explicitly accounts for model accuracy, while remaining delay-efficient. Simulation results on public datasets show that our approach can improve accuracy by 3%, while reducing delay by 20% and overhead by 50%, compared to state-of-the-art SFL and HSFL schemes.

联邦学习模型分片低延迟优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。