arXiv:2502.11031cs.LG2025-02综述

厘清神经网络中两种主要偏见的本质,助力公平可信AI发展

A Critical Review of Predominant Bias in Neural Networks

  • 提出两种偏见的数学定义,统一研究框架
  • 实验证明两类偏见本质不同且需分别应对
  • 为公平性研究提供方法与评估指引,适合相关方向学者

神经网络的偏见问题伴随其快速发展日益受到关注。其中,缓解两大主导性偏见至关重要:一是确保模型在不同人口群体间表现均衡,二是确保算法决策不依赖受保护属性。然而,通过对 cp篇相关文献的考察,我们发现这两类偏见存在长期、广泛但未被充分探讨的混淆现象,已严重影响社区理解与去偏方法的发展。本文旨在恢复清晰性,提出两类偏见的数学定义,并据此整合综述大量论文。进一步分析混淆的常见现象与成因,通过在合成数据、人口普查和图像数据集上的大量实验,验证两类偏见的独立性,区分其真实世界表现形式,并评估多种偏见评估指标的有效性。从成因、去偏方法、评估协议、常用数据集及未来方向等多维度比较二者差异。最后,提出若干建议,引导研究人员避免混淆,推动领域认知清晰化。

原文摘要 · Abstract (English)

Bias issues of neural networks garner significant attention along with its promising advancement. Among various bias issues, mitigating two predominant biases is crucial in advancing fair and trustworthy AI: (1) ensuring neural networks yields even performance across demographic groups, and (2) ensuring algorithmic decision-making does not rely on protected attributes. However, upon the investigation of \pc papers in the relevant literature, we find that there exists a persistent, extensive but under-explored confusion regarding these two types of biases. Furthermore, the confusion has already significantly hampered the clarity of the community and subsequent development of debiasing methodologies. Thus, in this work, we aim to restore clarity by providing two mathematical definitions for these two predominant biases and leveraging these definitions to unify a comprehensive list of papers. Next, we highlight the common phenomena and the possible reasons for the existing confusion. To alleviate the confusion, we provide extensive experiments on synthetic, census, and image datasets, to validate the distinct nature of these biases, distinguish their different real-world manifestations, and evaluate the effectiveness of a comprehensive list of bias assessment metrics in assessing the mitigation of these biases. Further, we compare these two types of biases from multiple dimensions including the underlying causes, debiasing methods, evaluation protocol, prevalent datasets, and future directions. Last, we provide several suggestions aiming to guide researchers engaged in bias-related work to avoid confusion and further enhance clarity in the community.

偏见分析公平性神经网络可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。