解决联邦学习中公平性与数据分布不均的矛盾,提升模型全局公平性。
WassFFed: Wasserstein Fair Federated Learning
- 用输出分布的Wasserstein均值聚合本地模型,确保公平性一致。
- 在三个真实数据集上,准确率与公平性平衡优于现有方法。
- 适合关注隐私保护下模型公平性的研究人员和工程师。
联邦学习(FL)通过分布式训练解决用户数据无法共享的问题。由于数据在不同用户群体间地理分布不均,实现公平性至关重要。现有公平性研究多假设可访问全部训练数据,难以直接应用于联邦学习。当前研究存在两大挑战:(CH1) 使用代理函数优化得到的公平结果与实际分类结果不一致;(CH2) 直接聚合本地公平模型无法保证全局模型公平,因客户端数据分布非独立同分布(non-IID)。为此,本文提出WassFFed框架。针对CH1,确保本地模型输出独立于用户群体;针对CH2,对每类用户群体的本地模型输出计算Wasserstein均值,使局部输出趋近全局分布,保障全局与局部的一致性。在三个真实数据集上进行大量实验,结果表明WassFFed在准确率与公平性之间取得更优平衡。
原文摘要 · Abstract (English)
Federated Learning (FL) employs a training approach to address scenarios where users' data cannot be shared across clients. Achieving fairness in FL is imperative since training data in FL is inherently geographically distributed among diverse user groups. Existing research on fairness predominantly assumes access to the entire training data, making direct transfer to FL challenging. However, the limited existing research on fairness in FL does not effectively address two key challenges, i.e., (CH1) Current methods fail to deal with the inconsistency between fair optimization results obtained with surrogate functions and fair classification results. (CH2) Directly aggregating local fair models does not always yield a globally fair model due to non Identical and Independent data Distributions (non-IID) among clients. To address these challenges, we propose a Wasserstein Fair Federated Learning framework, namely WassFFed. To tackle CH1, we ensure that the outputs of local models, rather than the loss calculated with surrogate functions or classification results with a threshold, remain independent of various user groups. To resolve CH2, we employ a Wasserstein barycenter calculation of all local models' outputs for each user group, bringing local model outputs closer to the global output distribution to ensure consistency between the global model and local models. We conduct extensive experiments on three real-world datasets, demonstrating that WassFFed outperforms existing approaches in striking a balance between accuracy and fairness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。