arXiv:2409.15828cs.CYcs.IR2024-09

剖析荷兰约会软件歧视案,揭示算法偏见的法律与技术难题

Digital Discrimination in Dating Apps and the Dutch Breeze case

  • 结合计算机科学与法律,解析荷兰对Breeze算法歧视黑皮肤用户的裁决
  • 认定基于种族的匹配算法歧视违法,要求平台采取措施防止歧视
  • 为约会类应用提供公平算法设计的实践指南,适合政策制定者与开发者

2023年,荷兰人权研究所(Netherlands Institute for Human Rights)作为荷兰反歧视机构,裁定荷兰约会应用Breeze的算法涉嫌对深肤色用户存在种族歧视。因此,该机构要求Breeze必须防止此类歧视行为。本文深入分析该裁决,探讨三个核心问题:Breeze裁决的主要内容是什么?其匹配算法中的种族歧视是否违法?以及约会应用如何缓解或消除算法歧视?文章揭示了约会应用在应对算法歧视时面临的法律与技术挑战,并提出若干可行解决方案。研究融合计算机科学与法学视角,讨论该判决对公平、无歧视机器学习领域学术与实践的深远影响。

原文摘要 · Abstract (English)

In 2023, the Netherlands Institute for Human Rights, the Dutch non-discrimination authority, decided that Breeze, a Dutch dating app, was justified in suspecting that their algorithm discriminated against dark-skinned users. Consequently, the Institute decided that Breeze must prevent this discrimination based on ethnicity. This paper analyses the decision and explores three questions.What are the main points of the Breeze decision? Is the discrimination based on ethnicity in Breeze's matching algorithm illegal? We also explore a more general question: how can dating apps mitigate or stop discrimination in their matching algorithms? We illustrate the legal and technical difficulties dating apps face in tackling discrimination and highlight some promising solutions. We analyse the Breeze decision in-depth, combining insights from computer science and law. We discuss the implications of this judgment for scholarship and practice in the field of fair and non-discriminatory machine learning.

算法公平约会应用种族歧视AI治理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。