在多个表现相近的模型中,有意选择更公平的模型能显著降低不公平性。
Be Intentional About Fairness!: Fairness, Size, and Multiplicity in the Rashomon Set
- 提出高效采样与筛选公平模型的方法,基于统计守恒性评估公平性
- 计算出个体预测在模型集内被翻转的概率,发现群体差异性存在风险
- 揭示模型多重性对公平性的双重影响,适合关注算法公正性的研究者
当从多个预测性能相近的模型中选择时,能多大程度减少不公平性?是否必须有意识地优先考虑公平性,还是随意选择即可?近年来的研究指出,模型多重性——即同一任务下存在多个几乎同等准确的模型——对公平性既有利也有弊,既可强化人工智能中的民事权利执法,也可能暴露决策任意性。尽管其影响重大,但关于等效模型集合(即Rashomon集)的性质仍缺乏系统研究。本文提出五项理论与方法贡献,深入探索了Rashomon集在公平性方面的未解问题:包括高效采样方法、根据统计均等性等关键公平指标识别最公平模型的技术;推导个体预测在集合内被翻转的概率,以及集合规模和误差容限分布的表达式。这些结果带来政策启示:必须有意识地在Rashomon集中寻找公平模型,并识别哪些个体或群体更容易受到任意决策的影响。
原文摘要 · Abstract (English)
When selecting a model from a set of equally performant models, how much unfairness can you really reduce? Is it important to be intentional about fairness when choosing among this set, or is arbitrarily choosing among the set of ''good'' models good enough? Recent work has highlighted that the phenomenon of model multiplicity-where multiple models with nearly identical predictive accuracy exist for the same task-has both positive and negative implications for fairness, from strengthening the enforcement of civil rights law in AI systems to showcasing arbitrariness in AI decision-making. Despite the enormous implications of model multiplicity, there is little work that explores the properties of sets of equally accurate models, or Rashomon sets, in general. In this paper, we present five main theoretical and methodological contributions which help us to understand the relatively unexplored properties of the Rashomon set, in particular with regards to fairness. Our contributions include methods for efficiently sampling models from this set and techniques for identifying the fairest models according to key fairness metrics such as statistical parity. We also derive the probability that an individual's prediction will be flipped within the Rashomon set, as well as expressions for the set's size and the distribution of error tolerance used across models. These results lead to policy-relevant takeaways, such as the importance of intentionally looking for fair models within the Rashomon set, and understanding which individuals or groups may be more susceptible to arbitrary decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。