通过打乱图像和变换技术,揭示CNN分类中的隐性偏见。
Identifying bias in CNN image classification using image scrambling and transforms
- 将图像分块打乱或应用傅里叶、小波等变换,检测模型依赖的背景信息
- 在6个数据集上验证,能有效区分上下文信息与噪声干扰
- 适用于图像分类中偏见检测,尤其适合无空白背景场景
CNN在图像分类中广泛应用,但其决策过程如黑箱般难以解释,易受难以察觉的背景信息影响。本文探讨了此类隐藏偏见,并提出两种检测方法:一是将图像分割为不重叠的块并随机打乱,二是应用傅里叶变换、小波变换及中值滤波等操作及其组合,以恢复模型依赖的背景噪声。这些方法在六个不同数据集(包括自然、合成与混合数据集)上测试,结果表明能有效区分上下文信息与背景噪声,即使在无空白背景的情况下仍可识别模型对无关特征的学习。该方法为理解并检测深层网络偏见提供了实用工具。
原文摘要 · Abstract (English)
CNNs are now prevalent as the primary choice for most machine vision problems due to their superior rate of classification and the availability of user-friendly libraries. These networks effortlessly identify and select features in a non-intuitive data-driven manner, making it difficult to determine which features were most influential. That leads to a ``black box", where users cannot know how the image data are analyzed but rely on empirical results. Therefore the decision-making process can be biased by background information that is difficult to detect. Here we discuss examples of such hidden biases and propose techniques for identifying them, methods to distinguish between contextual information and background noise, and explore whether CNNs learn from irrelevant features. One effective approach to identify dataset bias is to classify blank background parts of the images. However, in some situations a blank background in the images is not available, making it more difficult to separate the foreground information from the blank background. Such parts of the image can also be considered contextual learning, not necessarily bias. To overcome this, we propose two approaches that were tested on six different datasets, including natural, synthetic, and hybrid datasets. The first method involves dividing images into smaller, non-overlapping tiles of various sizes, which are then shuffled randomly, making classification more challenging. The second method involves the application of several image transforms, including Fourier, Wavelet transforms, and Median filter, and their combinations. These transforms help recover background noise information used by CNN to classify images. Results indicate that this method can effectively distinguish between contextual information and background noise, and alert on the presence of background noise even without the need to use background information.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。