让人工参与公平性模型选择,平衡多个冲突的公平目标。
A Human-in-the-Loop Fairness-Aware Model Selection Framework for Complex Fairness Objective Landscapes
- 将多个公平指标视为冲突目标,构建多目标优化框架。
- 在法学院录取案例中有效平衡多种公平性要求,减少自证预言风险。
- 适合需要兼顾社会影响与法律合规的公平算法设计者使用。
公平感知机器学习(FairML)应用常涉及复杂的社会目标和法律要求,通常包含多个潜在冲突的公平概念。尽管公平性的不可能定理及对统计与社会技术权衡的广泛理论研究已存在,但许多FairML工具仍仅优化或约束单一公平目标。这种单向优化可能无意中违反其他相关公平概念。在此项社会技术与实证研究中,我们将公平性建模为多目标(MaO)问题,将公平指标视为冲突目标。我们提出ManyFairHPO——一种人工介入、公平感知的模型选择框架,使实践者能够有效导航复杂的公平性目标景观。ManyFairHPO帮助识别、评估并调和公平性指标间的冲突及其相关社会后果,从而做出更明智、更具社会责任感的模型选择决策。通过全面的实证评估及法学院录取案例研究,我们证明ManyFairHPO在平衡多个公平目标、缓解如自证预言等风险方面有效,并为利益相关方提供可解释洞察,以指导公平感知建模决策。
原文摘要 · Abstract (English)
Fairness-aware Machine Learning (FairML) applications are often characterized by complex social objectives and legal requirements, frequently involving multiple, potentially conflicting notions of fairness. Despite the well-known Impossibility Theorem of Fairness and extensive theoretical research on the statistical and socio-technical trade-offs between fairness metrics, many FairML tools still optimize or constrain for a single fairness objective. However, this one-sided optimization can inadvertently lead to violations of other relevant notions of fairness. In this socio-technical and empirical study, we frame fairness as a many-objective (MaO) problem by treating fairness metrics as conflicting objectives. We introduce ManyFairHPO, a human-in-the-loop, fairness-aware model selection framework that enables practitioners to effectively navigate complex and nuanced fairness objective landscapes. ManyFairHPO aids in the identification, evaluation, and balancing of fairness metric conflicts and their related social consequences, leading to more informed and socially responsible model-selection decisions. Through a comprehensive empirical evaluation and a case study on the Law School Admissions problem, we demonstrate the effectiveness of ManyFairHPO in balancing multiple fairness objectives, mitigating risks such as self-fulfilling prophecies, and providing interpretable insights to guide stakeholders in making fairness-aware modeling decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。