用图像变换检测CNN模型中的隐含偏见,无需裁剪背景。
Identifying Bias in Deep Neural Networks Using Image Transforms
- 通过傅里叶、小波、中值滤波等变换识别模型依赖的背景偏见
- 在无空白背景情况下仍能检测到数据集偏见导致的性能误判
- 适合关注模型公平性与可解释性的研究人员使用
近年来,卷积神经网络(CNN)已成为主流计算工具之一。其主要缺陷在于“黑箱”特性,用户难以了解图像数据如何被分析,只能依赖经验评估模型性能,这可能导致隐藏偏见影响评价结果且难以发现。本文分析了常见基准数据集中存在的隐含偏见,并提出一种无需裁剪图像背景即可识别数据集偏见的方法。该方法基于对原始图像施加傅里叶变换、小波变换、中值滤波及其组合,恢复模型用于分类的背景偏见信息。这些变换对上下文视觉信息与系统性背景偏见的影响不同,因此能够区分二者,从而在不分离空白背景区域的情况下,有效检测背景偏见的存在。实验代码已公开。
原文摘要 · Abstract (English)
CNNs have become one of the most commonly used computational tool in the past two decades. One of the primary downsides of CNNs is that they work as a ``black box", where the user cannot necessarily know how the image data are analyzed, and therefore needs to rely on empirical evaluation to test the efficacy of a trained CNN. This can lead to hidden biases that affect the performance evaluation of neural networks, but are difficult to identify. Here we discuss examples of such hidden biases in common and widely used benchmark datasets, and propose techniques for identifying dataset biases that can affect the standard performance evaluation metrics. One effective approach to identify dataset bias is to perform image classification by using merely blank background parts of the original images. However, in some situations a blank background in the images is not available, making it more difficult to separate foreground or contextual information from the bias. To overcome this, we propose a method to identify dataset bias without the need to crop background information from the images. That method is based on applying several image transforms to the original images, including Fourier transform, wavelet transforms, median filter, and their combinations. These transforms were applied to recover background bias information that CNNs use to classify images. This transformations affect the contextual visual information in a different manner than it affects the systemic background bias. Therefore, the method can distinguish between contextual information and the bias, and alert on the presence of background bias even without the need to separate sub-images parts from the blank background of the original images. Code used in the experiments is publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。