arXiv:2609.05174cs.CVcs.LG2026-09

提出可自解释的多模态医疗诊断模型,提升准确率与可解释性。

SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis

论文配图:SMILE: Self-Explainable Multimodal Information Bottleneck for Medical Diagnosis
图 1 · 摘自论文原文
  • 基于信息瓶颈框架,联合优化诊断性能与模态特异性解释
  • 在iCTCF数据集上准确率提升9.1个百分点,显著优于现有方法
  • 适用于多模态医疗场景,适合临床AI系统开发者使用

可解释性在基于AI的医疗诊断中日益重要,尤其在高风险临床决策中。现有可解释方法多为事后分析且主要针对单模态数据,难以适应日益普遍的多模态诊断场景。本文将自解释多模态诊断问题纳入信息瓶颈(IB)框架,提出统一学习范式,通过识别各模态中对诊断决策最具信息量的成分,同时优化预测性能与模态特定可解释性。为实现可计算且稳定的优化,假设编码器充分表达下采用矩阵形式的Renyi α-阶熵函数。在涵盖异构模态的代表性医学数据集上的大量实验表明,该方法持续取得优异诊断表现,例如在iCTCF数据集上绝对准确率提升9.1个百分点。此外,所学解释能提供透明、模态感知的特征相关性洞察,从而增强可解释性与泛化能力。

原文摘要 · Abstract (English)

Explainability is increasingly seen as a crucial requirement in AI-based medical diagnosis, particularly in safety-critical clinical decision-making. Most existing explainability methods in healthcare operate in a post-hoc manner and are predominantly designed for unimodal data, which limits their applicability in increasingly prevalent multimodal diagnostic settings. This paper addresses the problem of self-explainable multimodal diagnosis by formulating it within the information bottleneck (IB) framework. We propose a unified learning paradigm that jointly optimizes predictive performance and modality-specific explainability by identifying the most informative elements inside each modality that contribute to diagnostic decisions. To enable tractable and stable optimization, we employ a matrix-based Renyi's $\alpha$-order entropy functional under the assumption of sufficiently expressive encoders. Extensive experiments on representative medical datasets spanning heterogeneous modalities demonstrate that the proposed method consistently achieves strong diagnostic performance, including an absolute accuracy improvement of 9.1 percentage points on the iCTCF dataset. Moreover, the learned explanations provide transparent and modality-aware insights into feature relevance, thereby improving both the explainability and generalization.

医疗AI多模态可解释性信息瓶颈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。