让AI在不确定时主动放弃诊断,提升医疗文本分析可靠性。
Uncertainty-aware abstention in medical diagnosis based on medical texts
- 引入不确定性感知机制,让模型在没把握时选择不预测。
- HUQ-2方法在多个医疗数据集上显著提升判断可靠性。
- 适合需要高可信度的临床辅助诊断系统开发者参考。
本研究针对人工智能辅助医疗诊断中的可靠性问题,聚焦于允许诊断系统在信心不足时主动放弃决策的选别预测方法。这类选择性预测(或弃权)通常依赖于对机器学习模型预测不确定性的建模。本文探索了用于医疗文本分析的不确定性量化方法,涵盖多项任务与多个数据集:基于MIMIC-III的文本数据进行二分类死亡预测、基于MIMIC-IV的ICD-10代码进行多标签医疗编码预测,以及使用私有门诊数据集进行多分类任务。此外,还分析了用于抑郁与焦虑检测的心理健康数据集,涉及论文、社交媒体帖子和临床描述等多种文本来源。除了对比多种不确定性方法外,本文提出H UQ-2,一种新的前沿方法,可显著增强选择性预测任务的可靠性。实验结果详细比较了不同不确定性量化方法,证明了HUQ-2在捕捉与评估不确定性方面的有效性,为医疗文本分析中更可靠、可解释的应用铺平道路。
原文摘要 · Abstract (English)
This study addresses the critical issue of reliability for AI-assisted medical diagnosis. We focus on the selection prediction approach that allows the diagnosis system to abstain from providing the decision if it is not confident in the diagnosis. Such selective prediction (or abstention) approaches are usually based on the modeling predictive uncertainty of machine learning models involved. This study explores uncertainty quantification in machine learning models for medical text analysis, addressing diverse tasks across multiple datasets. We focus on binary mortality prediction from textual data in MIMIC-III, multi-label medical code prediction using ICD-10 codes from MIMIC-IV, and multi-class classification with a private outpatient visits dataset. Additionally, we analyze mental health datasets targeting depression and anxiety detection, utilizing various text-based sources, such as essays, social media posts, and clinical descriptions. In addition to comparing uncertainty methods, we introduce HUQ-2, a new state-of-the-art method for enhancing reliability in selective prediction tasks. Our results provide a detailed comparison of uncertainty quantification methods. They demonstrate the effectiveness of HUQ-2 in capturing and evaluating uncertainty, paving the way for more reliable and interpretable applications in medical text analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。