用线性组合统一衡量预测算法的准确与公平,解决二者权衡难题。
Aggregating Concepts of Fairness and Accuracy in Prediction Algorithms
- 提出用线性加权融合准确率与公平性指标
- 在COMPAS数据集上验证了权衡效果
- 适合关注算法伦理与性能平衡的研究者
预测算法通常以输出准确结果为目标,而随着人工智能的发展,公平性也日益重要,即避免对特定个体或群体产生系统性偏见。然而,准确与公平常存在冲突,且两者有多种衡量方式,缺乏整合这些指标的明确准则。本文基于哈桑尼的经典偏好聚合理论,论证采用准确与公平指标的线性组合来评估算法整体价值具有合理性。通过分析安格温等人收集的COMPAS数据集,展示了该方法在处理准确性与公平性权衡中的应用可行性。
原文摘要 · Abstract (English)
An algorithm that outputs predictions about the state of the world will almost always be designed with the implicit or explicit goal of outputting accurate predictions (i.e., predictions that are likely to be true). In addition, the rise of increasingly powerful predictive algorithms brought about by the recent revolution in artificial intelligence has led to an emphasis on building predictive algorithms that are fair, in the sense that their predictions do not systematically evince bias or bring about harm to certain individuals or groups. This state of affairs presents two conceptual challenges. First, the goals of accuracy and fairness can sometimes be in tension, and there are no obvious normative guidelines for managing the trade-offs between these two desiderata when they arise. Second, there are many distinct ways of measuring both the accuracy and fairness of a predictive algorithm; here too, there are no obvious guidelines on how to aggregate our preferences for predictive algorithms that satisfy disparate measures of fairness and accuracy to various extents. The goal of this paper is to address these challenges by arguing that there are good reasons for using a linear combination of accuracy and fairness metrics to measure the all-things-considered value of a predictive algorithm for agents who care about both accuracy and fairness. My argument depends crucially on a classic result in the preference aggregation literature due to Harsanyi. After making this formal argument, I apply my result to an analysis of accuracy-fairness trade-offs using the COMPAS dataset compiled by Angwin et al.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。