通过社区悬赏发现AI偏见,让普通人也能参与检测算法不公平。
The Current State of AI Bias Bounties: An Overview of Existing Programmes and Research
- 用悬赏激励普通用户报告AI系统中的偏见问题。
- 现有项目多为美国机构组织的限时竞赛,奖金7000至24000美元。
- 适合关注AI公平性、想降低参与门槛的研究者与实践者。
当前的AI偏见评估方法很少与受其影响的社群互动。受漏洞悬赏启发,偏见悬赏被提出作为一种奖励机制,邀请AI系统的使用者报告在使用中遇到的偏见。由于缺乏综述性研究,本文旨在识别并分析现有的AI偏见悬赏项目,并梳理相关学术文献。通过Google、Google Scholar、PhilPapers和IEEE Xplore检索,共发现五个偏见悬赏项目及五篇研究论文。所有项目均由美国机构组织,为限时竞赛形式,其中四个项目面向公众开放,奖金池介于7,000至24,000美元之间。研究论文涵盖漏洞悬赏应用于算法危害的报告、对Twitter偏见悬赏的分析、将偏见悬赏作为提升AI审查的制度化机制的提案、从酷儿视角探讨偏见悬赏的研讨会,以及一个偏见悬赏的算法框架。研究认为降低技术门槛对吸引无编程经验者至关重要。鉴于偏见悬赏应用仍有限,未来应借鉴漏洞悬赏的最佳实践,探索如何设计更具包容性的方案,并降低组织参与门槛。
原文摘要 · Abstract (English)
Current bias evaluation methods rarely engage with communities impacted by AI systems. Inspired by bug bounties, bias bounties have been proposed as a reward-based method that involves communities in AI bias detection by asking users of AI systems to report biases they encounter when interacting with such systems. In the absence of a state-of-the-art review, this survey aimed to identify and analyse existing AI bias bounty programmes and to present academic literature on bias bounties. Google, Google Scholar, PhilPapers, and IEEE Xplore were searched, and five bias bounty programmes, as well as five research publications, were identified. All bias bounties were organised by U.S.-based organisations as time-limited contests, with public participation in four programmes and prize pools ranging from 7,000 to 24,000 USD. The five research publications included a report on the application of bug bounties to algorithmic harms, an article addressing Twitter's bias bounty, a proposal for bias bounties as an institutional mechanism to increase AI scrutiny, a workshop discussing bias bounties from queer perspectives, and an algorithmic framework for bias bounties. We argue that reducing the technical requirements to enter bounty programmes is important to include those without coding experience. Given the limited adoption of bias bounties, future efforts should explore the transferability of the best practices from bug bounties and examine how such programmes can be designed to be sensitive to underrepresented groups while lowering adoption barriers for organisations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。