为公平性提供理论保障,适用于随机与确定性分类器。
PAC-Bayesian Generalization Guarantees for Fairness on Stochastic and Deterministic Classifiers
- 基于PAC-Bayes框架,统一处理随机与确定性分类器的公平性分析。
- 提出可优化的自绑定算法,同时平衡预测风险与公平性约束。
- 在三种经典公平度量上验证了边界紧致性,方法通用性强。
传统PAC泛化界无法在预测风险与公平性约束之间提供充分的理论保障。本文提出一个PAC-Bayes框架,用于推导公平性的泛化界,涵盖随机与确定性分类器。对于随机分类器,使用标准PAC-Bayes技术得到公平性界;对于确定性分类器,借助近期的PAC-Bayes进展,将公平性界拓展至非随机情形。该框架具备两大优势:(i) 适用于可表达为风险差异的广泛公平度量;(ii) 推出一种自绑定学习算法,直接优化预测风险与公平性泛化界的权衡。我们在三个经典公平度量上进行实验,不仅验证了框架的有效性,也展示了边界紧致性。
原文摘要 · Abstract (English)
Classical PAC generalization bounds on the prediction risk of a classifier are insufficient to provide theoretical guarantees on fairness when the goal is to learn models balancing predictive risk and fairness constraints. We propose a PAC-Bayesian framework for deriving generalization bounds for fairness, covering both stochastic and deterministic classifiers. For stochastic classifiers, we derive a fairness bound using standard PAC-Bayes techniques. Whereas for deterministic classifiers, as usual PAC-Bayes arguments do not apply directly, we leverage a recent advance in PAC-Bayes to extend the fairness bound beyond the stochastic setting. Our framework has two advantages: (i) It applies to a broad class of fairness measures that can be expressed as a risk discrepancy, and (ii) it leads to a self-bounding algorithm in which the learning procedure directly optimizes a trade-off between generalization bounds on the prediction risk and on the fairness. We empirically evaluate our framework with three classical fairness measures, demonstrating not only its usefulness but also the tightness of our bounds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。