arXiv:2410.02331cs.CV2024-10综述被引 49

让医学影像AI自己解释决策过程,提升可信度与透明性

Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks

  • 将可解释性嵌入深度学习训练过程,实现内在解释
  • 涵盖200+论文,覆盖影像模态与临床应用全链条
  • 适合医疗AI研发者、临床医生及政策制定者参考

医疗影像分析等高风险决策领域对模型透明性与可靠性需求日益增长,推动了可解释人工智能(XAI)的发展。后处理XAI方法虽能解释黑箱模型,但存在解释真实性存疑的问题。自解释AI(S-XAI)通过在训练中直接融入可解释性,使模型生成与其内部决策过程紧密关联的内在解释,显著提升系统的透明度、可信度与问责性。本文综述了超过200篇相关论文,从三个维度系统梳理:1)通过可解释特征工程与知识图谱实现输入可解释;2)基于注意力、概念和原型的学习实现模型可解释;3)通过文本与反事实解释实现输出可解释。文章还提出了可解释性的理想特征与评估方法,讨论了当前挑战与未来方向。

原文摘要 · Abstract (English)

The increasing demand for transparent and reliable models, particularly in high-stakes decision-making areas such as medical image analysis, has led to the emergence of eXplainable Artificial Intelligence (XAI). Post-hoc XAI techniques, which aim to explain black-box models after training, have raised concerns about their fidelity to model predictions. In contrast, Self-eXplainable AI (S-XAI) offers a compelling alternative by incorporating explainability directly into the training process of deep learning models. This approach allows models to generate inherent explanations that are closely aligned with their internal decision-making processes, enhancing transparency and supporting the trustworthiness, robustness, and accountability of AI systems in real-world medical applications. To facilitate the development of S-XAI methods for medical image analysis, this survey presents a comprehensive review across various image modalities and clinical applications. It covers more than 200 papers from three key perspectives: 1) input explainability through the integration of explainable feature engineering and knowledge graph, 2) model explainability via attention-based learning, concept-based learning, and prototype-based learning, and 3) output explainability by providing textual and counterfactual explanations. This paper also outlines desired characteristics of explainability and evaluation methods for assessing explanation quality, while discussing major challenges and future research directions in developing S-XAI for medical image analysis.

可解释AI医学影像自解释深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。