为放疗勾画流程引入认知不确定性估计,提升模型可靠性。
Towards Integrating Epistemic Uncertainty Estimation into the Radiotherapy Workflow
- 在放疗器官勾画中引入认知不确定性评估,识别模型不可靠预测。
- 对植入物病例实现0.92敏感度与0.95特异性,AUC-ROC达0.95。
- 首次在获批临床系统中实证应用,适合医疗AI落地场景。
放疗规划中目标结构与危及器官(OAR)的勾画精度对治疗效果和患者安全至关重要。深度学习虽显著提升了OAR勾画性能,但在分布外(OOD)场景下的可靠性仍是临床担忧。本研究探索将认知不确定性估计融入OAR勾画工作流,以实现临床相关场景中的OOD检测,使用特定构建的数据集。同时提出一种先进的统计方法增强不确定性评估框架。实证评估表明,认知不确定性估计能有效识别模型不可靠预测,需专家复核。特别地,该方法在植入物病例上达到0.95的AUC-ROC,特异性0.95,敏感度0.92,证明其有效性。研究填补了当前缺乏不确定性评估真值标签及实证评估不足的空白,并在Varian(西门子健康事业部)的获批临床解决方案中实现了临床应用,凸显其实用价值。
原文摘要 · Abstract (English)
The precision of contouring target structures and organs-at-risk (OAR) in radiotherapy planning is crucial for ensuring treatment efficacy and patient safety. Recent advancements in deep learning (DL) have significantly improved OAR contouring performance, yet the reliability of these models, especially in the presence of out-of-distribution (OOD) scenarios, remains a concern in clinical settings. This application study explores the integration of epistemic uncertainty estimation within the OAR contouring workflow to enable OOD detection in clinically relevant scenarios, using specifically compiled data. Furthermore, we introduce an advanced statistical method for OOD detection to enhance the methodological framework of uncertainty estimation. Our empirical evaluation demonstrates that epistemic uncertainty estimation is effective in identifying instances where model predictions are unreliable and may require an expert review. Notably, our approach achieves an AUC-ROC of 0.95 for OOD detection, with a specificity of 0.95 and a sensitivity of 0.92 for implant cases, underscoring its efficacy. This study addresses significant gaps in the current research landscape, such as the lack of ground truth for uncertainty estimation and limited empirical evaluations. Additionally, it provides a clinically relevant application of epistemic uncertainty estimation in an FDA-approved and widely used clinical solution for OAR segmentation from Varian, a Siemens Healthineers company, highlighting its practical benefits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。