让深度学习更像人脑:解释性、因果推理与生物视觉结合提升医学图像分类
Human-aligned Deep Learning: Explainability, Causality, and Biological Inspiration
- 从可解释性、因果关系和生物视觉三方面构建人机对齐的深度学习框架
- 提出CROCODILE框架,利用弱因果信号提升模型泛化能力与可解释性
- 受人类视觉机制启发,设计上下文感知注意力网络,增强医学图像识别
本文旨在使深度学习更贴近人类认知能力,以实现更高效、可解释且鲁棒的图像分类。从可解释性、因果推理和生物视觉三个角度切入。首先评估神经网络在医学图像上的可视化技术,并验证一种面向可解释性的乳腺肿块分类方法。接着系统梳理可解释AI与因果机器学习的交叉研究,提出通用研究框架。在因果方向,设计利用医学图像中特征共现的新模块,提升预测效果与可解释性;进一步提出CROCODILE框架,整合因果概念、对比学习、特征解耦与先验知识,增强模型泛化能力。最后借鉴人类视觉机制,提出CoCoReco网络,通过连接性启发的注意力机制实现上下文感知识别。关键发现包括:(i) 简单激活最大化对医学图像模型缺乏洞察力;(ii) 原型-部分学习有效且符合放射科临床习惯;(iii) XAI与因果机器学习深度相关;(iv) 无需先验信息即可利用弱因果信号改善性能与可解释性;(v) 框架在多个医学领域及分布外数据上表现良好;(vi) 引入生物电路特征可提升人机对齐识别效果。本工作推动人对齐深度学习发展,为研究与临床应用融合提供路径,有助于提升信任度、诊断准确性和安全部署。
原文摘要 · Abstract (English)
This work aligns deep learning (DL) with human reasoning capabilities and needs to enable more efficient, interpretable, and robust image classification. We approach this from three perspectives: explainability, causality, and biological vision. Introduction and background open this work before diving into operative chapters. First, we assess neural networks' visualization techniques for medical images and validate an explainable-by-design method for breast mass classification. A comprehensive review at the intersection of XAI and causality follows, where we introduce a general scaffold to organize past and future research, laying the groundwork for our second perspective. In the causality direction, we propose novel modules that exploit feature co-occurrence in medical images, leading to more effective and explainable predictions. We further introduce CROCODILE, a general framework that integrates causal concepts, contrastive learning, feature disentanglement, and prior knowledge to enhance generalization. Lastly, we explore biological vision, examining how humans recognize objects, and propose CoCoReco, a connectivity-inspired network with context-aware attention mechanisms. Overall, our key findings include: (i) simple activation maximization lacks insight for medical imaging DL models; (ii) prototypical-part learning is effective and radiologically aligned; (iii) XAI and causal ML are deeply connected; (iv) weak causal signals can be leveraged without a priori information to improve performance and interpretability; (v) our framework generalizes across medical domains and out-of-distribution data; (vi) incorporating biological circuit motifs improves human-aligned recognition. This work contributes toward human-aligned DL and highlights pathways to bridge the gap between research and clinical adoption, with implications for improved trust, diagnostic accuracy, and safe deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。