判断医疗数据是否足够,避免盲目采集更多指标。
A Personalized Computational Framework for Assessing the Sufficiency of Partially Observed Data in Healthcare AI models
- 基于可用特征推断缺失变量分布,评估数据充分性。
- 在心外科术后和门诊队列中验证,性能接近完整数据。
- 可识别难预测人群,支持低成本数据采集决策。
实现疾病的早期及时诊断与治疗是重大挑战。近年来,基于患者数据训练的机器学习(ML)算法在预测患者健康状态方面展现出潜力。但应用中常面临临床变量(特征)不全的问题。本文定义了全特征容量(FFC)——即使用全部训练特征时的预测性能。提出特征充分性分析(FSA),用于判断某部分临床特征是否足以达到FFC。FSA通过条件分布估计缺失变量,提供患者级的充分性评估。若满足,则无需额外采集数据即可进行可靠预测。本文展示两个案例:心脏手术后患者需要长期通气的预测,以及门诊队列10年死亡率预测。结果表明,FSA不仅能生成可解释的特征重要性排序,识别难以预测的患者群体,还可支持成本敏感的数据采集优化。FSA为判断不完整临床信息是否足以支撑可信医疗AI决策提供了通用计算框架,有助于在多样临床环境中部署AI系统。
原文摘要 · Abstract (English)
Achieving early and timely diagnosis and treatment for disease is a major challenge. Recent applications of machine learning (ML) algorithms trained on patient data have shown promise in many different settings for predicting the patient health state. A challenge often faced when applying these ML algorithms is that at any given time, not all clinical variables (features) needed as input to perform prediction tasks are available. We define the concept of full-feature-capacity (FFC) to refer to prediction performance when such algorithms make use of all features on which they were trained. We then introduce Feature Sufficiency Analysis (FSA) - an analysis for determining whether a subset of all clinical features needed by an AI model is sufficient to achieve FFC. FSA estimates the underlying distributions of missing variables conditioned on features that are available. FSA provides a patient-specific assessment of whether the existing set of measured features achieves FFC. If yes, then there is no need to acquire further inputs and a ML-based prediction. We provide two case studies: prediction of need for postoperative prolonged ventilation in patients recovering from heart surgery; 10-year mortality prediction in an outpatient cohort. We also demonstrate that FSA also provides a clinically interpretable feature-ranking methodology based on prediction sufficiency, identifies intrinsically hard-to-predict patient populations, and has the potential to perform cost-aware optimization for clinical data acquisition. FSA provides a generic computational approach for determining whether incomplete clinical information is sufficient to support trustworthy AI-assisted clinical decision-making, thereby facilitating the prospective deployment of healthcare AI systems across diverse clinical settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。