根据客户端状态动态调整模型拆分点,提升联邦学习效率与效果
When Is Shallow Enough? Adaptive Split Federated Learning with Client-Specific Sufficiency Estimation

- 通过私有提示词追踪客户端适配动态,判断是否需要更深网络
- 在多个异构数据集上性能超越现有方法,减少客户端无效计算
- 适合资源不均、数据分布差异大的实际联邦学习场景
分割式联邦学习(SFL)通过将网络模型在服务器与客户端之间拆分实现分布式训练。然而,在客户端异构性背景下,传统静态拆分策略可能低效,因为各客户端在数据分布、适配动态和表征学习进度上存在差异,单一拆分点难以适应不同客户端的训练状态。本文提出FedSGA框架,基于客户端特定的浅层充分性估计,实现自适应拆分。首先,引入基于私有提示词的客户端适配通道,独立于共享主干网络追踪本地适配动态,提供轻量级信号以检测适配是否仍在进行。为避免多次在线探测不同深度,设计了一个浅层充分性估计算子,结合跨客户端语义对齐、时间接口稳定性及提示状态变化来判断最浅拆分点是否已足够。最后,引入拆分兼容接口调和模块,将不同拆分深度的激活映射至共享语义空间,提升异构客户端接口间的可比性,优化服务器端预测。在多个异构基准数据集上的大量实验表明,相比现有最优方法,FedSGA在提升模型性能的同时显著降低了不必要的客户端计算开销。
原文摘要 · Abstract (English)
\textit{Split Federated Learning} (SFL) enables distributed model training by splitting networks between the server and clients. However, under client heterogeneity, the conventional static split strategy may be suboptimal because clients can differ in data distributions, adaptation dynamics, and representation learning progress, making a single split point insufficient to accommodate client-specific training states. In this paper, we propose \textsc{FedSGA}, a \textbf{S}ufficiency-\textbf{G}uided \textbf{A}daptive split \textbf{Fed}erated learning framework that addresses this question through client-specific shallow sufficiency estimation. First, we introduce a client-specific adaptation channel based on private prompt tokens, which tracks local adaptation dynamics separately from the shared backbone and provides a lightweight signal for detecting whether client adaptation remains active. To further avoid repeated online probing over multiple candidate depths, we design a shallow sufficiency estimator that combines cross-client semantic alignment, temporal interface stability, and prompt-state variation to estimate whether the shallowest split is already sufficient. Finally, we introduce a split-compatible interface harmonization module that projects activations from different split depths into a shared semantic space, improving the comparability of heterogeneous client interfaces before server-side prediction. Extensive experiments on multiple heterogeneous benchmarks demonstrate the effectiveness of \textsc{FedSGA} in improving model performance compared with state-of-the-art methods while reducing unnecessary client-side computation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。