arXiv:2608.23031cs.LGcs.AI2026-08中稿 · Globecom 2026

让模型识别不确定样本,缓解联邦学习中的标签偏斜问题。

FedCC: Towards Addressing Label Distribution Skews in Distillation-Based Federated Learning

论文配图:FedCC: Towards Addressing Label Distribution Skews in Distillation-Based Federated Learning
图 1 · 摘自论文原文
  • 客户端对模糊样本标记为'未知',避免错误分类。
  • 极端偏斜下准确率达67.3%,远超基线的随机水平。
  • 适合数据分布不均的联邦学习场景,如医疗或边缘设备。

联邦学习(FL)使分布式客户端可在不共享原始数据的情况下协同训练模型,适用于通信网络中大量设备的利用。在基于知识蒸馏的联邦学习中,各客户端在其本地模型上对无标签公共数据集进行预测,并仅将结果上传至服务器。然而,本地数据的异质性导致标签分布偏斜,使客户端模型偏向多数类,引发预测不准确。由于公共数据集缺乏真实标签,服务器难以校准预测,最终降低整体性能。为此,我们提出FedCC,一种简单有效的算法以缓解客户端误分类。客户端不再被迫分类,而是可将模糊样本标记为'未知'。这一新增类别结合经过校准的伪标签,平衡了对多数类的信心与对少数类的不确定性。大量实验表明,FedCC显著优于现有方法,尤其在严重标签偏斜下表现突出。在极端情况下,每个客户端仅持有十个类别之一的数据时,FedCC达到67.3%准确率,而基线方法接近随机水平。

原文摘要 · Abstract (English)

Federated Learning (FL) enables distributed clients to collaboratively train models without sharing raw data, making it promising for leveraging massive devices in communication networks. In distillation-based FL, each client applies its local model on an unlabeled public dataset, and shares only prediction results with the server. While heterogeneous local data introduces label distribution skew, thus biasing client models toward majority classes and leading to potentially inaccurate predictions. The lack of ground-truth labels in the public dataset hampers the server's ability to calibrate predictions, which ultimately degrades overall performance. To address this, we propose FedCC, a simple and effective algorithm for mitigating client misclassification. Instead of being forced to classify and risking error propagation, clients are allowed to tag ambiguous samples as 'unknown'. This additional class, together with calibrated pseudo-labels on the public data, balances confidence in majority classes against uncertainty in under-represented ones. Extensive experiments demonstrate that FedCC significantly outperforms existing methods, especially under severe label skew. In the extreme scenario where each client holds samples from only one of ten classes, FedCC achieves 67.3% accuracy, while baselines collapse to near-random results.

联邦学习标签偏斜知识蒸馏模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。