厘清AI偏见的本质,分类并提供检测与缓解方法。
Fantastic Biases (What are They) and Where to Find Them
- 从模式相关性出发定义偏见,揭示其普遍存在性。
- 提出常见负向偏见的系统性分类图谱。
- 提供基于模板数据集和算法的检测与缓解方案。
深度学习模型在大规模数据上倾向于捕捉模式间的相关性。随着模型规模扩大,其可探测现象日益复杂,所需数据量也相应增加。人工智能的应用正日益普及,其影响持续增长。其承诺能否实现,取决于是否公平、普适地使用,如确保所有人获得信息与教育机会。在存在不平等的世界中,人工智能本可帮助最弱势群体,但此类普适系统必须能真实反映社会,避免以牺牲部分群体为代价。我们不应复制全球存在的不平等,而应引导人工智能超越这些不平等。已有案例显示,系统会不恰当地利用性别、种族甚至阶级信息完成任务,而非进行真正因果推理,这正是我们通常所说的偏见。本文首先尝试在一般意义上定义偏见,以消解其神秘性,理解为何偏见无处不在且有时有用。其次,聚焦通常被视为负面的偏见,即机器学习中需避免的类型,并构建了最常见的偏见分类图谱。最后,通过设计特定模板数据集与专用算法,总结经典检测方法,并回顾常见的缓解策略。
原文摘要 · Abstract (English)
Deep Learning models tend to learn correlations of patterns on huge datasets. The bigger these systems are, the more complex are the phenomena they can detect, and the more data they need for this. The use of Artificial Intelligence (AI) is becoming increasingly ubiquitous in our society, and its impact is growing everyday. The promises it holds strongly depend on their fair and universal use, such as access to information or education for all. In a world of inequalities, they can help to reach the most disadvantaged areas. However, such a universal systems must be able to represent society, without benefiting some at the expense of others. We must not reproduce the inequalities observed throughout the world, but educate these IAs to go beyond them. We have seen cases where these systems use gender, race, or even class information in ways that are not appropriate for resolving their tasks. Instead of real causal reasoning, they rely on spurious correlations, which is what we usually call a bias. In this paper, we first attempt to define what is a bias in general terms. It helps us to demystify the concept of bias, to understand why we can find them everywhere and why they are sometimes useful. Second, we focus over the notion of what is generally seen as negative bias, the one we want to avoid in machine learning, before presenting a general zoology containing the most common of these biases. We finally conclude by looking at classical methods to detect them, by means of specially crafted datasets of templates and specific algorithms, and also classical methods to mitigate them.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。