用全局聚类分析模型决策依据,发现图像分类中的隐藏捷径。
ReMoDEx: A Local-to-Global Relevance-Based Model Decision Explainability Framework for large-Scale Image Datasets
- 通过局部解释方法+全局聚类,自动总结大规模图像决策模式。
- 在新冠分类任务中发现两种稳定策略:中心区域依赖与边缘敏感,准确率达86.27%。
- 适合关注模型可信性、避免捷径学习的研究者使用。
深度学习图像分类器虽预测性能强,但决策过程不透明。模型可能正确分类却依赖无关线索、捷径关联或设备伪影而非任务相关区域。在大规模数据集上,逐样本检查热图难以扩展。我们提出基于显著性的模型决策可解释框架ReMoDEx,构建从模型推理、目标类别选择、显著性图生成、热图标准化、基于相似性的模式聚类、聚类层面解读到空间显著性评估的全流程。将GradCAM++、Integrated Gradients、Occlusion Sensitivity和Layerwise Relevance Propagation等局部方法分别与单一全局模块结合,将整组显著性图归纳为少数决策策略集群,替代人工逐样本分析。以基于VGG16的新冠分类器(区分COVID-19、正常、肺部阴影、病毒性肺炎)为例,该模型测试准确率为86.27%,测试AUC为0.9624。但各解释器配合全局模块均揭示出两类重复出现的策略:中心胸腔区域依赖与边缘/角落敏感。遮挡验证表明,遮盖中心或外围区域会改变模型置信度与预测类别。ReMoDEx提供可扩展的显著性驱动决策评估框架,是准确率评估的重要补充。
原文摘要 · Abstract (English)
Deep learning image classifiers achieve strong predictive performance yet remain opaque in how decisions are formed. A model may predict correctly while relying on irrelevant cues, shortcut associations, peripheral structures, or device level artifacts instead of task relevant regions. On large scale datasets this opacity is especially problematic, since inspecting heatmaps one sample at a time cannot scale to thousands of predictions. We propose Relevance Based Model Decision Explainability (ReMoDEx), a framework for systematic, dataset scale assessment of model decision behaviour in image classification. ReMoDEx defines a stepwise pipeline: model inference, target class selection, relevance map generation, heatmap standardisation, similarity based grouping of patterns, cluster level interpretation, and spatial relevance assessment. Local methods GradCAM++, Integrated Gradients, Occlusion Sensitivity, and Layerwise Relevance Propagation are each combined independently with a single global module that summarises an entire set of relevance maps into a few decision strategy clusters, replacing sample by sample inspection with an automatic, scalable summary. To demonstrate ReMoDEx, we applied it to a VGG16 based classifier distinguishing COVID-19, Normal, Lung Opacity, and Viral Pneumonia. The classifier showed stable performance (86.27% test accuracy, 0.9624 test AUC). However, each explainer combined with the global module consistently produced two recurring strategies: central thoracic region decisions and border/corner sensitive decisions, indicating possible shortcut learning that conventional metrics could not reveal. Masked image validation confirmed that model confidence and predicted class changed when central or peripheral regions were occluded. ReMoDEx thus provides a scalable relevance based decision assessment framework and an essential complement to accuracy based evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。