arXiv:2606.16362eess.IVcs.AI2026-06

用输入依赖的Fisher信息分析医学图像分类器的局部敏感性。

Input-Dependent Fisher Information for Local Sensitivity Analysis of Medical Image Classifiers

论文配图:Input-Dependent Fisher Information for Local Sensitivity Analysis of Medical Image Classifiers
图 1 · 摘自论文原文
  • 基于输入依赖的Fisher信息矩阵,量化输入微小变化对预测分布的影响。
  • 高敏感度成分与预测置信度变化关联更强,优于低敏感度互补成分。
  • 适合需要理解模型决策依据的医学影像研究者使用。

深度神经网络在医学图像分类中表现优异,但常作为黑箱。现有后处理解释方法多为启发式可视化,与预测分布关系间接。本文提出基于训练分类器输入依赖的Fisher信息矩阵(iFIM)的局部敏感性分析框架。iFIM刻画了输入图像在无穷小扰动下预测分布的变化特性。通过格拉姆矩阵形式,无需显式构造全图像维度的Fisher矩阵即可恢复其非零特征谱。将输入图像投影至iFIM主导特征空间的高局部敏感分量及其正交分量,提供模型内在的局部预测敏感性描述,而非传统的像素级归因热图或任务相关解剖结构因果分割。在多个分类器架构的受控及临床医学图像分类任务上进行了评估。扰动实验表明,高敏感度的iFIM分量比低敏感度互补分量更强烈地耦合于预测置信度和分类性能的变化。结果支持iFIM框架作为分析局部决策敏感性的原理性工具,并可补充现有基于归因的可解释性方法。

原文摘要 · Abstract (English)

Deep neural networks have achieved strong performance in medical image classification, but often work like black-box. Commonly used post-hoc interpretation methods often provide heuristic visualizations whose relationship to the classifier's predictive distribution is indirect. This work introduces a local sensitivity analysis framework based on the input-dependent Fisher Information Matrix (iFIM) of a trained classifier. The iFIM characterizes how the classifier's predictive distribution changes under infinitesimal perturbations of the input image. By using a Gram-matrix formulation, the nonzero eigenspectrum of the iFIM can be recovered without explicitly forming the full image-dimensional Fisher matrix. The leading iFIM eigenspace is then used to project an input image into a high local-sensitivity component and its orthogonal component. These components provide a model-intrinsic description of local predictive sensitivity, rather than a conventional pixel-wise attribution heatmap or a causal segmentation of task-relevant anatomy. The framework is evaluated on controlled and clinical medical image classification tasks using multiple classifier architectures. Perturbation-based experiments show that high-sensitivity iFIM components are more strongly coupled to changes in predictive confidence and classification performance than lower-sensitivity complementary components. The results support the iFIM framework as a principled tool for analyzing local decision sensitivity and for complementing existing attribution-based interpretability methods in medical imaging.

可解释性医学影像敏感性分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。