arXiv:2504.15924cs.LGcs.AI2025-04

用不确定性加权实现联邦学习中的公平分配,支持四种正义原则。

Achieving Distributive Justice in Federated Learning via Uncertainty Quantification

  • 基于不确定性加权与资源分配思想,灵活实现多种公平目标。
  • 在四种正义原则下均实现客户端公平,优于主流方法。
  • 适合关注公平性伦理的实践者,尤其在数据分布不均场景。

联邦学习中的客户端公平性指标旨在确保所有客户端在本地数据分布上的最终表现:要么表现一致(客户端平等),要么与其对联邦过程的贡献成比例(贡献公平)。尽管部分工作将公平性定义基于社会平等理论(如分配正义),但多数方法随意选择公平标准,使实践者难以抉择。本文提出UDJ-FL(基于不确定性的分配正义联邦学习)框架,通过借鉴公平资源分配策略并结合随机不确定性加权,可同时实现功绩、功利、罗尔斯差异原则及平等主义四类分配正义下的客户端公平。实验表明,UDJ-FL能有效达成这四种公平目标,且公平性优于或等同于其他主流公平联邦学习方法。进一步,我们论证了随机不确定性加权在框架中的必要性,并推导了其泛化误差的理论保证。代码已开源:https://github.com/alycia-noel/UDJ-FL。

原文摘要 · Abstract (English)

Client-level fairness metrics for federated learning are used to ensure that all clients in a federation either: a) have similar final performance on their local data distributions (i.e., client parity), or b) obtain final performance on their local data distributions relative to their contribution to the federated learning process (i.e., contribution fairness). While a handful of works that propose either client-parity or contribution-based fairness metrics ground their definitions and decisions in social theories of equality -- such as distributive justice -- most works arbitrarily choose what notion of fairness to align with which makes it difficult for practitioners to choose which fairness metric aligns best with their fairness ethics. In this work, we propose UDJ-FL (Uncertainty-based Distributive Justice for Federated Learning), a flexible federated learning framework that can achieve multiple distributive justice-based client-level fairness metrics. Namely, by utilizing techniques inspired by fair resource allocation, in conjunction with performing aleatoric uncertainty-based client weighing, our UDJ-FL framework is able to achieve egalitarian, utilitarian, Rawls' difference principle, or desert-based client-level fairness. We empirically show the ability of UDJ-FL to achieve all four defined distributive justice-based client-level fairness metrics in addition to providing fairness equivalent to (or surpassing) other popular fair federated learning works. Further, we provide justification for why aleatoric uncertainty weighing is necessary to the construction of our UDJ-FL framework as well as derive theoretical guarantees for the generalization bounds of UDJ-FL. Our code is publicly available at https://github.com/alycia-noel/UDJ-FL.

联邦学习公平性分配正义不确定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。