提出新公平性框架,提升监狱风险评估模型的公正性与准确性。
Exploring Equality: An Investigation into Custom Loss Functions for Fairness Definitions
- 设计定制损失函数,实现新型公平性框架GAP
- GAP在公平性与准确率间取得更好平衡
- 适合关注算法公平与司法系统改革的研究者
本文研究了在COMPAS模型中,等几率、差异影响、等机会等公平性指标与预测准确率之间的复杂权衡。通过构建针对特定公平性标准优化的自定义损失函数训练神经网络,首次实现了Gupta等人(2024)提出的新型群体准确率一致(Group Accuracy Parity, GAP)框架的公平驱动式落地应用。为有效评估不同公平性目标下的模型表现,本文提出结合帕累托前沿与多变量分析的综合分析方法,并借助小提琴图等数据可视化手段进行比较。结果表明,相较于当前全国部署的COMPAS版本及其基于传统公平性定义的改进版本,GAP在公平性与准确性之间实现了更优平衡。尽管算法层面的改进显著提升了公平性,但外部偏见仍削弱实际应用中的公平性。预测警务实践及COMPAS内部机制缺乏透明度等问题,加剧了其历史不公。因此,必须同步推进方法论革新与法律制度变革,才能实现该模型的公正部署。
原文摘要 · Abstract (English)
This paper explores the complex tradeoffs between various fairness metrics such as equalized odds, disparate impact, and equal opportunity and predictive accuracy within COMPAS by building neural networks trained with custom loss functions optimized to specific fairness criteria. This paper creates the first fairness-driven implementation of the novel Group Accuracy Parity (GAP) framework, as theoretically proposed by Gupta et al. (2024), and applies it to COMPAS. To operationalize and accurately compare the fairness of COMPAS models optimized to differing fairness ideals, this paper develops and proposes a combinatory analytical procedure that incorporates Pareto front and multivariate analysis, leveraging data visualizations such as violin graphs. This paper concludes that GAP achieves an enhanced equilibrium between fairness and accuracy compared to COMPAS's current nationwide implementation and alternative implementations of COMPAS optimized to more traditional fairness definitions. While this paper's algorithmic improvements of COMPAS significantly augment its fairness, external biases undermine the fairness of its implementation. Practices such as predictive policing and issues such as the lack of transparency regarding COMPAS's internal workings have contributed to the algorithm's historical injustice. In conjunction with developments regarding COMPAS's predictive methodology, legal and institutional changes must happen for COMPAS's just deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。