arXiv:2602.20068cs.CVcs.LG2026-02中稿 · CVPR

发现图像识别模型对相似颜色的异常检测更敏感,易漏判不相似的异常。

The Invisible Gorilla Effect in Out-of-distribution Detection

  • 通过改变异常颜色与模型关注区的相似度,测试检测效果差异。
  • 相同模型在相似颜色异常上AUROC高出31.5%,不同时大幅下降。
  • 适用于提升模型鲁棒性、评估检测器真实性能的研究者。

深度神经网络在视觉任务中通过学习图像感兴趣区域(ROI)特征取得高精度,但在分布外(OOD)数据上性能下降。现有研究显示不同类型的异常检测效果不同,但原因未明。本文揭示一种未被注意的偏差:对于难检测的近分布外异常,当异常与模型关注区在视觉上相似(如颜色)时,检测性能提升;反之则下降,称为“隐形大猩猩效应”。例如,在以红色病灶为关注区的皮肤病变分类器中,马氏距离得分在检测红色墨水异常时比黑色墨水异常的AUROC高出31.5%。我们在三个公开数据集(如ISIC)的11,355张图像上按颜色标注异常,并生成颜色替换的反事实样本以排除数据集偏差。在7个基准上评估40种OOD方法,发现多数方法在异常与ROI颜色不同时性能显著下降。结果揭示了当前OOD检测中的关键缺陷,为设计更鲁棒的检测器提供指导。代码与标注已开源。

原文摘要 · Abstract (English)

Deep Neural Networks achieve high performance in vision tasks by learning features from regions of interest (ROI) within images, but their performance degrades when deployed on out-of-distribution (OOD) data that differs from training data. This challenge has led to OOD detection methods that aim to identify and reject unreliable predictions. Although prior work shows that OOD detection performance varies by artefact type, the underlying causes remain underexplored. To this end, we identify a previously unreported bias in OOD detection: for hard-to-detect artefacts (near-OOD), detection performance typically improves when the artefact shares visual similarity (e.g. colour) with the model's ROI and drops when it does not - a phenomenon we term the Invisible Gorilla Effect. For example, in a skin lesion classifier with red lesion ROI, we show the method Mahalanobis Score achieves a 31.5% higher AUROC when detecting OOD red ink (similar to ROI) compared to black ink (dissimilar) annotations. We annotated artefacts by colour in 11,355 images from three public datasets (e.g. ISIC) and generated colour-swapped counterfactuals to rule out dataset bias. We then evaluated 40 OOD methods across 7 benchmarks and found significant performance drops for most methods when artefacts differed from the ROI. Our findings highlight an overlooked failure mode in OOD detection and provide guidance for more robust detectors. Code and annotations are available at: https://github.com/HarryAnthony/Invisible_Gorilla_Effect.

OOD检测模型偏差鲁棒性医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。