arXiv:2603.03007cs.LGcs.DC2026-03

解决联邦学习中少数类数据偏差问题,提升模型公平性与准确率。

Breaking the Prototype Bias Loop: Confidence-Aware Federated Contrastive Learning for Highly Imbalanced Clients

  • 基于置信度加权聚合本地原型,降低高方差样本影响。
  • 在极端不平衡下,准确率提升最高达12.3%,公平性显著改善。
  • 适合数据分布极不均衡的现实联邦学习场景。

本地类别不平衡与客户端间数据异质性常导致基于原型的联邦对比学习陷入原型偏差循环:不平衡数据产生的偏差本地原型被聚合为偏差全局原型,并反复用作对比锚点,误差随通信轮次累积。为此,我们提出置信度感知联邦对比学习(CAFedCL),通过改进原型聚合机制并强化原型引导的对比对齐。CAFedCL采用置信度感知聚合机制,利用预测不确定性来降低高方差本地原型权重;同时引入少数类生成增强与几何一致性正则化,稳定类别间结构。理论上,我们提供基于期望的分析,证明该聚合可降低估计方差,从而限制全局原型漂移并保证收敛。在多种类别不平衡和数据异质性条件下,大量实验表明CAFedCL在准确率与客户端公平性上持续优于代表性联邦基线。

原文摘要 · Abstract (English)

Local class imbalance and data heterogeneity across clients often trap prototype-based federated contrastive learning in a prototype bias loop: biased local prototypes induced by imbalanced data are aggregated into biased global prototypes, which are repeatedly reused as contrastive anchors, accumulating errors across communication rounds. To break this loop, we propose Confidence-Aware Federated Contrastive Learning (CAFedCL), a novel framework that improves the prototype aggregation mechanism and strengthens the contrastive alignment guided by prototypes. CAFedCL employs a confidence-aware aggregation mechanism that leverages predictive uncertainty to downweight high-variance local prototypes. In addition, generative augmentation for minority classes and geometric consistency regularization are integrated to stabilize the structure between classes. From a theoretical perspective, we provide an expectation-based analysis showing that our aggregation reduces estimation variance, thereby bounding global prototype drift and ensuring convergence. Extensive experiments under varying levels of class imbalance and data heterogeneity demonstrate that CAFedCL consistently outperforms representative federated baselines in both accuracy and client fairness.

联邦学习类别不平衡对比学习公平性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。