arXiv:2409.15338cs.CYcs.AI2024-09被引 5

定义医疗AI好解释的标准,解决可解释性难题。

Explainable AI: Definition and attributes of a good explanation for health AI

  • 从文献与专家共识出发构建医疗AI解释定义
  • 提出10项关键属性确保解释有效可用
  • 为临床可信AI提供可操作标准,适合医工交叉研究者

基于日益复杂且精准的预测模型的人工智能解决方案在多个领域广泛应用。随着模型复杂度提升,透明度与用户理解能力往往下降,表明仅具备准确预测不足以使AI方案真正有用。在医疗系统开发中,这引发问责与安全新问题。理解AI推荐的依据可能需要对其内部机制和推理过程进行复杂解释。尽管近年来可解释人工智能(XAI)研究显著增长且医学领域需求迫切,但何为优质解释仍缺乏统一定义,提供充分解释仍具挑战。为充分发挥AI潜力,亟需回答两个根本问题:(1)医疗AI中的解释是什么?(2)医疗AI中优质解释的特征为何?本研究通过分析已有文献并开展两轮德尔菲专家调研,得出(1)医疗AI中解释的定义,以及(2)一套全面刻画优质解释的属性清单。

原文摘要 · Abstract (English)

Proposals of artificial intelligence (AI) solutions based on increasingly complex and accurate predictive models are becoming ubiquitous across many disciplines. As the complexity of these models grows, transparency and users' understanding often diminish. This suggests that accurate prediction alone is insufficient for making an AI-based solution truly useful. In the development of healthcare systems, this introduces new issues related to accountability and safety. Understanding how and why an AI system makes a recommendation may require complex explanations of its inner workings and reasoning processes. Although research on explainable AI (XAI) has significantly increased in recent years and there is high demand for XAI in medicine, defining what constitutes a good explanation remains ad hoc, and providing adequate explanations continues to be challenging. To fully realize the potential of AI, it is critical to address two fundamental questions about explanations for safety-critical AI applications, such as health-AI: (1) What is an explanation in health-AI? and (2) What are the attributes of a good explanation in health-AI? In this study, we examined published literature and gathered expert opinions through a two-round Delphi study. The research outputs include (1) a definition of what constitutes an explanation in health-AI and (2) a comprehensive list of attributes that characterize a good explanation in health-AI.

可解释AI医疗AI解释性标准德尔菲法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。