系统梳理机器学习偏见的来源与缓解方法,为招聘算法提供可落地的公平性框架。
Whither Bias Goes, I Will Go: An Integrative, Systematic Review of Algorithmic Bias Mitigation
- 构建四阶段模型:数据生成、模型训练、测试、部署,逐阶段识别偏见源。
- 整合中美欧法律要求与多种领域缓解策略,验证其合法有效性。
- 适合组织研究者、数据科学家及政策制定者参考,推动跨学科合作。
机器学习模型在人员评估与选拔(如简历筛选、自动评分面试)中应用日益广泛,但社会普遍担忧其可能带有偏见并加剧不平等。尽管组织研究者已从心理测量学和法律视角开展研究,仍亟需整合计算机科学、数据科学与组织研究文献中的公平性定义及算法偏见缓解方法。本文提出一个四阶段模型:1)生成训练数据,2)训练模型,3)测试模型,4)部署模型,并在各阶段分析潜在偏见与不公平来源。系统回顾了算法偏见的定义与操作化方式、美国与欧洲人员选拔相关法律要求,以及多领域中的偏见缓解研究,并将其整合进该框架。研究揭示了算法偏见的作用机制,明确了合法且有效的缓解方法,同时指出当前知识缺口,呼吁组织研究者、计算机科学家与数据科学家开展协同研究。文章提供了开发与部署机器学习评估系统的建议,以及未来研究方向。
原文摘要 · Abstract (English)
Machine learning (ML) models are increasingly used for personnel assessment and selection (e.g., resume screeners, automatically scored interviews). However, concerns have been raised throughout society that ML assessments may be biased and perpetuate or exacerbate inequality. Although organizational researchers have begun investigating ML assessments from traditional psychometric and legal perspectives, there is a need to understand, clarify, and integrate fairness operationalizations and algorithmic bias mitigation methods from the computer science, data science, and organizational research literatures. We present a four-stage model of developing ML assessments and applying bias mitigation methods, including 1) generating the training data, 2) training the model, 3) testing the model, and 4) deploying the model. When introducing the four-stage model, we describe potential sources of bias and unfairness at each stage. Then, we systematically review definitions and operationalizations of algorithmic bias, legal requirements governing personnel selection from the United States and Europe, and research on algorithmic bias mitigation across multiple domains and integrate these findings into our framework. Our review provides insights for both research and practice by elucidating possible mechanisms of algorithmic bias while identifying which bias mitigation methods are legal and effective. This integrative framework also reveals gaps in the knowledge of algorithmic bias mitigation that should be addressed by future collaborative research between organizational researchers, computer scientists, and data scientists. We provide recommendations for developing and deploying ML assessments, as well as recommendations for future research into algorithmic bias and fairness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。