arXiv:2509.18132cs.AI2025-09中稿 · the International …

让医疗AI既懂预测又会说‘我多有把握’,提升临床信任度。

Position Paper: Integrating Explainability and Uncertainty Estimation in Medical AI

  • 融合可解释性与不确定性量化,生成带信心程度的医学判断。
  • 提出多模态不确定性建模与无模型可视化等技术方向。
  • 适合关注医疗AI可信度、临床落地的研究者与医生。

不确定性是医疗实践中的核心挑战,但现有医疗AI系统无法以符合临床推理的方式显式量化或传达不确定性。当前XAI研究聚焦于解释模型预测,却未捕捉预测的置信度或可靠性;而不确定性估计(UE)虽提供置信度指标,却缺乏直观解释。二者脱节限制了AI在医学中的应用。为此,我们提出可解释不确定性估计(XUE),将可解释性与不确定性量化相结合,以增强医疗AI的信任度与可用性。我们系统映射医疗不确定性到AI不确定性概念,识别实现XUE的关键挑战,提出技术方向,包括多模态不确定性量化、模型无关可视化技术及不确定性感知决策支持系统。最后,提出确保有效实现XUE的指导原则。分析强调:需开发不仅能生成可靠预测,还能以临床有意义方式表达置信水平的AI系统。本工作通过弥合可解释性与不确定性,推动可信医疗AI的发展,为契合真实临床复杂性的系统铺路。

原文摘要 · Abstract (English)

Uncertainty is a fundamental challenge in medical practice, but current medical AI systems fail to explicitly quantify or communicate uncertainty in a way that aligns with clinical reasoning. Existing XAI works focus on interpreting model predictions but do not capture the confidence or reliability of these predictions. Conversely, uncertainty estimation (UE) techniques provide confidence measures but lack intuitive explanations. The disconnect between these two areas limits AI adoption in medicine. To address this gap, we propose Explainable Uncertainty Estimation (XUE) that integrates explainability with uncertainty quantification to enhance trust and usability in medical AI. We systematically map medical uncertainty to AI uncertainty concepts and identify key challenges in implementing XUE. We outline technical directions for advancing XUE, including multimodal uncertainty quantification, model-agnostic visualization techniques, and uncertainty-aware decision support systems. Lastly, we propose guiding principles to ensure effective XUE realisation. Our analysis highlights the need for AI systems that not only generate reliable predictions but also articulate confidence levels in a clinically meaningful way. This work contributes to the development of trustworthy medical AI by bridging explainability and uncertainty, paving the way for AI systems that are aligned with real-world clinical complexities.

医疗AI可解释性不确定性估计可信度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。