arXiv:2605.17508cs.LGcs.AI2026-05

针对非独立同分布数据下的联邦学习偏差问题,提出结构感知的新型聚合与协同机制。

BESplit: Bias-Compensated Split Federated Learning with Evidential Aggregation

论文配图:BESplit: Bias-Compensated Split Federated Learning with Evidential Aggregation
图 1 · 摘自论文原文
  • 引入证据聚合机制,按不确定性精细重加权客户端贡献
  • 通过配对互补客户端对齐分层表示,缓解数据分布偏移
  • 采用双教师蒸馏实现模型解耦同步,支持本地独立推理

分割联邦学习(SFL)通过在客户端与服务器间拆分模型,实现隐私保护下的协同训练。然而,在非独立同分布(non-IID)数据下,SFL常面临优化偏差和收敛不稳问题,现有方法多沿用传统联邦学习技术。本文观察到SFL的分层架构改变了客户端信息的表达与协调方式,为超越参数级聚合的偏差补偿提供了新机会。为此,提出BESplit框架:首先引入证据聚合(EA),基于证据不确定性对客户端贡献进行细粒度重加权;其次设计偏差补偿协作(BCC),通过配对互补客户端对齐分层表示以减少分布偏移;最后引入双教师蒸馏(DTD),实现解耦客户端与服务器模型间的知识同步,支持独立本地推理。在五个基准数据集上的大量实验表明,BESplit在多种non-IID设置下均显著优于现有先进方法,在准确率、收敛稳定性与计算效率上表现更优。

原文摘要 · Abstract (English)

Split Federated Learning (SFL) enables privacy-preserving collaborative training by partitioning models between clients and a server. However, under non-IID data distributions, SFL often suffers from biased optimization and unstable convergence, while existing solutions largely adapt techniques from conventional federated learning. In this work, we observe that the split architecture of SFL inherently alters how client information is represented and coordinated, opening opportunities for bias compensation beyond parameter-level aggregation. Based on this insight, we propose BESplit, an architecture-aware framework that exploits the intrinsic structure of SFL to mitigate non-IID effects. First, to prevent biased local data from dominating global updates, we introduce Evidential Aggregation (EA) to perform fine-grained reweighting of client contributions based on evidential uncertainty. Second, to further reduce distributional skew, we develop Bias-Compensated Collaboration (BCC) to align split-layer representations by pairing complementary clients. Finally, Dual-Teacher Distillation (DTD) is incorporated to synchronize knowledge between decoupled client and server models, enabling independent local inference. Extensive experiments on five benchmark datasets demonstrate that BESplit consistently outperforms state-of-the-art methods in accuracy, convergence stability, and computational efficiency under diverse non-IID settings.

联邦学习非IID模型分层知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。