arXiv:2503.10567cs.LG2025-03被引 2

提出新方法提升联邦学习中罕见数据与错误标注的区分能力

FedPCA: Noise-Robust Fair Federated Learning via Performance-Capacity Analysis

  • 通过性能-容量分析识别异常客户端,结合损失与特征离散度
  • 在三个数据集上实现公平性与鲁棒性的平衡,显著降低错误标注影响
  • 适合关注数据质量不一致场景的联邦学习研究者

在联邦学习中,有效处理常见与罕见数据以实现性能公平至关重要。现有公平联邦学习方法虽有效,但对错误标注数据仍敏感。公平与鲁棒性存在内在冲突,导致鲁棒策略损害公平性。本文指出,这种冲突源于罕见数据与错误标注客户端在损失模式上的同质性,使基于损失的方法难以区分二者。为此,我们提出性能-容量分析,联合考虑每个客户端的模型表现及其数据处理能力,通过损失和新提出的特征离散度得分进行衡量。该方法能通过性能与容量的显著偏离识别错误标注客户端,同时保留罕见数据客户端。基于此,我们提出FedPCA:首先利用损失-离散度对的高斯混合模型识别错误标注客户端;然后在全局聚合与本地训练中分别调整客户端权重并选择可信数据,实现鲁棒公平。在三个数据集上的大量实验验证了方法的有效性。代码将在录用后公开。

原文摘要 · Abstract (English)

Training a model that effectively handles both common and rare data-i.e., achieving performance fairness-is crucial in federated learning (FL). While existing fair FL methods have shown effectiveness, they remain vulnerable to mislabeled data. Ensuring robustness in fair FL is therefore essential. However, fairness and robustness inherently compete, which causes robust strategies to hinder fairness. In this paper, we attribute this competition to the homogeneity in loss patterns exhibited by rare and mislabeled data clients, preventing existing loss-based fair and robust FL methods from effectively distinguishing and handling these two distinct client types. To address this, we propose performance-capacity analysis, which jointly considers model performance on each client and its capacity to handle the dataset, measured by loss and a newly introduced feature dispersion score. This allows mislabeled clients to be identified by their significantly deviated performance relative to capacity while preserving rare data clients. Building on this, we introduce FedPCA, an FL method that robustly achieves fairness. FedPCA first identifies mislabeled clients via a Gaussian Mixture Model on loss-dispersion pairs, then applies fairness and robustness strategies in global aggregation and local training by adjusting client weights and selectively using reliable data. Extensive experiments on three datasets demonstrate FedPCA's effectiveness in tackling this complex challenge. Code will be publicly available upon acceptance.

联邦学习公平性鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。