arXiv:2607.07236cs.CV2026-07被引 3

从隐空间到参数,多层级分析神经网络偏见来源。

Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision

论文配图:Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision
图 1 · 摘自论文原文
  • 分三层检测偏见:隐空间、激活值、模型参数
  • 在7.2万张人脸数据上验证,12.7万模型测试结果可靠
  • 突破黑箱局限,揭示偏见如何在模型内部演化

本研究通过多层次分析神经网络的隐空间、层激活和参数,系统探究偏见的存在与传播。提出三种新方法:SpaceBias利用邻近概率分布与柯尔莫戈洛夫-斯米尔诺夫检验分析隐空间偏见;ActivationBias基于曼-惠特尼U检验,检测低代表群体在最后卷积层激活水平更低的现象;WeightBias采用辅助网络直接识别任务模型参数中的偏见模式。实验在两个互补任务上进行:基于DiveFace数据集(7.2万张人脸图像)的性别分类,以及带可控偏见强度的彩色MNIST数字分类。共训练并评估超过12.7万种具有不同偏见程度与类型的模型。结果表明,当训练分布趋于平衡时,内部差异及检测性能呈平滑下降趋势,凸显深入理解模型行为的重要性。

原文摘要 · Abstract (English)

This study investigates the presence and propagation of bias within Neural Networks through a comprehensive multi-level analysis spanning the learned latent space, layer activations, and the network's parameters. Based on this taxonomy, we propose three bias detection approaches: 1) SpaceBias (new method), which characterizes the latent space prior to the final classification layer using neighbor-probability distributions and quantifies bias with the two-sample Kolmogorov-Smirnov test on the per-group distributions. 2) ActivationBias (extension of the existing method InsideBias), which analyzes the activations of neural network filters and quantifies bias via a Mann-Whitney U test, based on the observed fact that underrepresented groups exhibit lower activation levels in the final convolutional layers. 3) WeightBias (extension of the existing method IFBiD), which uses a secondary neural network trained to identify biased patterns directly in the parameters of task-specific models. Unlike conventional methods, which assess neural network outcomes and treat the model as a black box, our proposed techniques provide insight into how biases manifest within the network architecture itself at different levels, offering a more nuanced and detailed understanding. Experiments are conducted on two complementary applications: gender classification in the DiveFace dataset (72,000 face images) and digit classification on a colored-MNIST benchmark with controlled bias severity. In total, more than 127,000 models with varying degrees and types of bias were trained and evaluated. The severity sweep shows that the internal disparity, and with it the detection performance, decreases smoothly as the training distribution approaches balance. The results highlight the importance of methods that provide deeper insight into the behavior of AI models.

偏见检测神经网络多层级分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。