arXiv:2501.15318cs.LGcs.AI2025-01被引 3

通过后处理提升联邦学习公平性,无需修改训练过程。

A Post-Processing-Based Fair Federated Learning Framework

  • 先训练全局模型,再由各客户端本地做去偏处理。
  • 在四类数据上测试,公平性显著提升且准确率不降反增。
  • 适合对公平性有定制需求的异构联邦学习场景。

联邦学习(FL)允许多方在不集中数据的情况下协同训练模型,但其分布式特性带来了公平性挑战。本文提出一种基于后处理的公平联邦学习框架,分为两个阶段:首先使用标准联邦学习算法(如FedAvg)训练全局模型;其次各客户端利用本地数据对全局模型进行完全去中心化的公平性后处理。该框架支持根据客户端需求灵活调整公平性,我们验证了模型输出后处理和最后层微调两种方法。在包含表格、信号和图像数据的四个不同数据集上评估,覆盖多种数据异构性水平。结果表明,该框架不仅简化了公平性实现,还在跨模态和模型类型下显著提升公平性,同时保持甚至提高准确率,尤其在更异构的设置中效果更优。

原文摘要 · Abstract (English)

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The existing techniques are often limited in offering fairness flexibility to clients and performance. We formally define and empirically analyze a simple and intuitive post-processing-based framework to improve group fairness in FL systems. This framework can be divided into two stages: a standard FL training stage followed by a completely decentralized local debiasing stage. In the first stage, a global model is trained without fairness constraints using a standard federated learning algorithm (e.g. FedAvg). In the second stage, each client applies fairness post-processing on the global model using their respective local dataset. This allows for customized fairness improvements based on clients' desired and context-guided fairness requirements. We demonstrate two well-established post-processing techniques in this framework: model output post-processing and final layer fine-tuning. We evaluate the framework against three common baselines on four different datasets, including tabular, signal, and image data, each with varying levels of data heterogeneity across clients. Our work shows that this framework not only simplifies fairness implementation in FL but also provides significant fairness improvements with minimal accuracy loss or even accuracy gain, across data modalities and machine learning methods, being especially effective in more heterogeneous settings.

联邦学习公平性后处理去偏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。