arXiv:2602.00647cs.LG2026-02AAAI

解决联邦学习中的公平性问题,提升模型性能与一致性

CoRe-Fed: Bridging Collaborative and Representation Fairness via Federated Embedding Distillation

  • 通过嵌入对齐与动态加权机制,兼顾表示与协作公平性
  • 在多个数据集上显著降低客户端表现差异,提升整体性能
  • 适合关注联邦学习公平性与实际部署的开发者与研究者

随着分布式数据源的普及,联邦学习(FL)成为在保护数据隐私的前提下实现协同智能的关键方法。然而,传统FL算法常因数据分布异质性和参与不均导致客户端间性能差异,引发不公平结果。本文聚焦两大核心公平性挑战:表示偏差(源于客户端表征不一致)与协作偏差(源于聚合过程贡献不公),二者均损害模型性能与泛化能力。为此,提出CoRe-Fed统一优化框架,通过嵌入级正则化与公平感知聚合,同时缓解两类偏差。首先,采用对齐驱动机制促进本地与全局嵌入的语义一致性,减少表征差异;其次,设计基于动态奖惩的聚合策略,依据客户端参与历史与嵌入对齐程度调整权重,实现贡献感知的聚合。在多种模型与数据集上的大量实验表明,CoRe-Fed在公平性与模型性能方面均优于现有最优基线。

原文摘要 · Abstract (English)

With the proliferation of distributed data sources, Federated Learning (FL) has emerged as a key approach to enable collaborative intelligence through decentralized model training while preserving data privacy. However, conventional FL algorithms often suffer from performance disparities across clients caused by heterogeneous data distributions and unequal participation, which leads to unfair outcomes. Specifically, we focus on two core fairness challenges, i.e., representation bias, arising from misaligned client representations, and collaborative bias, stemming from inequitable contribution during aggregation, both of which degrade model performance and generalizability. To mitigate these disparities, we propose CoRe-Fed, a unified optimization framework that bridges collaborative and representation fairness via embedding-level regularization and fairness-aware aggregation. Initially, an alignment-driven mechanism promotes semantic consistency between local and global embeddings to reduce representational divergence. Subsequently, a dynamic reward-penalty-based aggregation strategy adjusts each client's weight based on participation history and embedding alignment to ensure contribution-aware aggregation. Extensive experiments across diverse models and datasets demonstrate that CoRe-Fed improves both fairness and model performance over the state-of-the-art baseline algorithms.

联邦学习公平性嵌入对齐模型聚合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。