arXiv:2503.13537cs.LGcs.DC2025-03被引 2

提出兼顾多层级公平与抗扰的联邦学习框架,解决模型偏倚和持续异常数据问题。

FedTilt: Towards Multi-Level Fairness-Preserving and Robust Federated Learning

  • 引入可调倾斜参数,同时优化客户端间与数据类别的公平性
  • 在真实联邦数据集上实现优于现有方法的公平性与鲁棒性表现
  • 适合关注隐私保护下模型公平性与稳定性研究的开发者

联邦学习(FL)是一种新兴的去中心化学习范式,可在一定程度上缓解传统集中式与分布式学习无法解决的隐私问题。为使联邦学习更具实用性,还需考虑公平性与鲁棒性等约束。然而,现有鲁棒性联邦学习方法常导致模型不公平,而现有公平性联邦学习方法仅关注单层级(客户端)公平性,且对现实场景中常见的持续异常数据(即每轮训练均注入的异常样本)缺乏鲁棒性。本文提出 exttt{FedTilt},一种能保持多层级公平性并抵抗异常数据的新型联邦学习框架。具体而言,我们考虑两种常见公平性层次: extit{客户端公平性}——跨客户端性能一致性,以及 extit{客户端数据公平性}——单个客户端内不同类别数据的性能一致性。 exttt{FedTilt} 受近期提出的倾斜经验风险最小化启发,引入可灵活调节的倾斜超参数。理论上,我们证明了调节倾斜值可实现双层公平性并缓解持续异常数据,并推导出 exttt{FedTilt} 的收敛条件。实证上,我们在多种真实联邦数据集的多样设置下评估,结果表明 exttt{FedTilt} 框架具有有效性与灵活性,显著优于当前最优方法。

原文摘要 · Abstract (English)

Federated Learning (FL) is an emerging decentralized learning paradigm that can partly address the privacy concern that cannot be handled by traditional centralized and distributed learning. Further, to make FL practical, it is also necessary to consider constraints such as fairness and robustness. However, existing robust FL methods often produce unfair models, and existing fair FL methods only consider one-level (client) fairness and are not robust to persistent outliers (i.e., injected outliers into each training round) that are common in real-world FL settings. We propose \texttt{FedTilt}, a novel FL that can preserve multi-level fairness and be robust to outliers. In particular, we consider two common levels of fairness, i.e., \emph{client fairness} -- uniformity of performance across clients, and \emph{client data fairness} -- uniformity of performance across different classes of data within a client. \texttt{FedTilt} is inspired by the recently proposed tilted empirical risk minimization, which introduces tilt hyperparameters that can be flexibly tuned. Theoretically, we show how tuning tilt values can achieve the two-level fairness and mitigate the persistent outliers, and derive the convergence condition of \texttt{FedTilt} as well. Empirically, our evaluation results on a suite of realistic federated datasets in diverse settings show the effectiveness and flexibility of the \texttt{FedTilt} framework and the superiority to the state-of-the-arts.

联邦学习公平性鲁棒性多层级

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。