提出新公平性度量,分析模型解释在不同群体间的稳定性差异。
GESD: Beyond Outcome-Oriented Fairness

- 用解释稳定性衡量不同群体的决策过程公平性
- 实验证明该方法能有效捕捉解释质量的群体差异
- 适合关注模型可解释性与公平性的研究人员
机器学习算法广泛应用于贷款审批、招聘和再犯预测等高风险决策领域。现有公平性度量(如统计均等、平等机会)虽能衡量结果偏差,却难以揭示偏见决策背后的推理过程。为此,我们提出群体级解释稳定性差异(GESD),一种面向流程的公平性度量,用于评估保护类别中不同子群体在模型解释的稳定性、鲁棒性和敏感性上的差异。GESD具有解释器无关、模型无关特性,拓展了公平性分析至可解释性层面。我们进一步将GESD融入多目标优化框架FEU(公平性-可解释性-效用),联合优化实用性、结果公平性和解释公平性。在多个基准数据集上的实验表明,GESD能有效捕捉解释质量的群体差异,且FEU在实用性和公平性上优于当前最优方法。通过连接结果公平性与解释公平性,GESD为诊断和缓解预测建模中的偏见提供了全面工具。代码与数据集已开源。
原文摘要 · Abstract (English)
Machine learning (ML) algorithms are increasingly deployed in high-stakes decision-making domains such as loan approvals, hiring, and recidivism predictions. While existing fairness metrics (e.g., statistical parity, equal opportunity) effectively quantify outcome-oriented disparities, they offer limited insight into the procedure or explanation behind biased decisions. To address this gap, we propose Group-level Explanation Stability Disparity (GESD), a \textit{procedural-oriented} fairness metric that measures disparities in the stability, robustness, and sensitivity of model explanations across different subgroups in a protected category. %GESD is explainer-agnostic, model-agnostic, and extends the scope of fairness analyses to the level of explainability. We further integrate GESD into a multi-objective optimization framework that jointly optimizes for utility, outcome-based fairness, and explanation-based fairness called FEU (Fairness--Explainability--Utility). Empirical results on multiple benchmark datasets show that GESD effectively captures group-wise discrepancies in explanation quality, and that FEU improves both utility and fairness over state-of-the-art methods. By bridging outcome-based and explanation-based fairness, GESD offers a comprehensive tool for diagnosing and mitigating bias in predictive modeling. Our code and datasets are available on GitHub {\hyperlink{https://github.com/horlahsunbo/GESD}{https://github.com/horlahsunbo/GESD}}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。