arXiv:2412.02275cs.CV2024-12被引 2

无需梯度即可生成高精度像素级解释图,适用于生物成像分析

PCIM: Learning Pixel Attributions via Pixel-wise Channel Isolation Mixing in High Content Imaging

  • 将每个像素视为独立通道,通过混合层生成可解释的注意力图
  • 在3个生物图像数据集上达到顶尖性能,定位准确率与模型保真度俱佳
  • 兼容任意深度网络,适合医疗影像等对可解释性要求高的场景

深度神经网络在计算机视觉任务中表现卓越,但其黑箱特性导致决策难以解释,尤其在生物医学应用中成为推广障碍。本文提出一种新方法——像素级通道隔离混合(PCIM),用于计算像素归属图,揭示分类决策中最关键的图像区域,且无需提取网络内部状态或梯度。不同于现有方法,PCIM将每个像素视为独立输入通道,并训练一个混合层来组合这些像素以反映特定分类结果。该方法可为每张图像生成像素级归属图,且不依赖具体分类网络结构。在三个与实际应用相关的高内涵成像数据集上进行基准测试,结果显示其在荧光和明场成像中均表现出领先的模型保真度与定位能力。PCIM是一种通用高效的像素级解释方法,适用于任意DNN,有助于提升模型可解释性与可信度。

原文摘要 · Abstract (English)

Deep Neural Networks (DNNs) have shown remarkable success in various computer vision tasks. However, their black-box nature often leads to difficulty in interpreting their decisions, creating an unfilled need for methods to explain the decisions, and ultimately forming a barrier to their wide acceptance especially in biomedical applications. This work introduces a novel method, Pixel-wise Channel Isolation Mixing (PCIM), to calculate pixel attribution maps, highlighting the image parts most crucial for a classification decision but without the need to extract internal network states or gradients. Unlike existing methods, PCIM treats each pixel as a distinct input channel and trains a blending layer to mix these pixels, reflecting specific classifications. This unique approach allows the generation of pixel attribution maps for each image, but agnostic to the choice of the underlying classification network. Benchmark testing on three application relevant, diverse high content Imaging datasets show state-of-the-art performance, particularly for model fidelity and localization ability in both, fluorescence and bright field High Content Imaging. PCIM contributes as a unique and effective method for creating pixel-level attribution maps from arbitrary DNNs, enabling interpretability and trust.

可解释AI生物成像像素归因深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。