提出量化后处理去偏策略公平性的新方法,避免修复偏差时制造新不公。
Transparency and Proportionality in Post-Processing Algorithmic Bias Correction
- 设计可衡量修正动作差异的指标,评估去偏策略是否合理。
- 揭示现有去偏方法可能在不同群体间造成不公平放大。
- 帮助开发者透明理解策略影响,选择更公平的干预方式。
算法决策系统常因对特定群体预测偏差导致不公平结果。在系统开发中应用的去偏实践,有时会引入新的不公平或加剧原有不平等。本文聚焦于分类任务中通过后处理修正算法输出以实现公平性的技术,分析其潜在副作用。为此,我们提出一组度量标准,用于量化后处理阶段对预测结果调整(翻转)的群体间差异。这些指标可帮助从业者:(1) 评估所用去偏策略的适度性;(2) 透明化了解该策略在各群体中的影响;(3) 基于分析结果判断是否需采用其他去偏方法。我们提出在后处理阶段应用这些指标的方法,并通过实例展示其实际用途。案例表明,分析去偏策略的比例性可补充传统公平性指标,为确保所有群体获得更公正的结果提供更深层视角。
原文摘要 · Abstract (English)
Algorithmic decision-making systems sometimes produce errors or skewed predictions toward a particular group, leading to unfair results. Debiasing practices, applied at different stages of the development of such systems, occasionally introduce new forms of unfairness or exacerbate existing inequalities. We focus on post-processing techniques that modify algorithmic predictions to achieve fairness in classification tasks, examining the unintended consequences of these interventions. To address this challenge, we develop a set of measures that quantify the disparity in the flips applied to the solution in the post-processing stage. The proposed measures will help practitioners: (1) assess the proportionality of the debiasing strategy used, (2) have transparency to explain the effects of the strategy in each group, and (3) based on those results, analyze the possibility of the use of some other approaches for bias mitigation or to solve the problem. We introduce a methodology for applying the proposed metrics during the post-processing stage and illustrate its practical application through an example. This example demonstrates how analyzing the proportionality of the debiasing strategy complements traditional fairness metrics, providing a deeper perspective to ensure fairer outcomes across all groups.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。