用噪声估计提升诊断模型鲁棒性,让医学影像系统更可靠
Informed Deep Abstaining Classifier: Investigating noise-robust training for diagnostic decision support systems
- 引入噪声水平信息改进训练损失,动态调整模型对不确定标签的处理
- 在模拟和真实噪声数据上均优于现有方法,准确率提升显著
- 适合医疗AI研发者利用临床文本数据构建高可信诊断系统
基于图像的诊断决策支持系统(DDSS)利用深度学习可优化临床流程,但需大量专家标注数据,成本高昂。通过自然语言处理从放射数据库中提取报告内容自动标注图像数据,可替代人工标注。然而,真实数据可能引入标签噪声,因此需要噪声鲁棒的训练损失。现有方法未考虑噪声水平估计,如由自动标签生成器性能推断的噪声程度。本研究将噪声鲁棒的深度弃权分类器(DAC)损失扩展为知情深度弃权分类器(IDAC)损失,训练中融入噪声水平估计。结果表明,IDAC在多种模拟噪声水平下优于DAC及多个先进损失函数。实验使用公开胸片数据集验证,结果在自建噪声数据集上复现,该数据集由波恩大学医院临床系统中基于Transformer的文本模型提取标签。因此,IDAC可为科研机构、企业或医院提供从常规临床数据开发准确可靠DDSS的有效工具。
原文摘要 · Abstract (English)
Image-based diagnostic decision support systems (DDSS) utilizing deep learning have the potential to optimize clinical workflows. However, developing DDSS requires extensive datasets with expert annotations and is therefore costly. Leveraging report contents from radiological data bases with Natural Language Processing to annotate the corresponding image data promises to replace labor-intensive manual annotation. As mining "real world" databases can introduce label noise, noise-robust training losses are of great interest. However, current noise-robust losses do not consider noise estimations that can for example be derived based on the performance of the automatic label generator used. In this study, we expand the noise-robust Deep Abstaining Classifier (DAC) loss to an Informed Deep Abstaining Classifier (IDAC) loss by incorporating noise level estimations during training. Our findings demonstrate that IDAC enhances the noise robustness compared to DAC and several state-of-the-art loss functions. The results are obtained on various simulated noise levels using a public chest X-ray data set. These findings are reproduced on an in-house noisy data set, where labels were extracted from the clinical systems of the University Hospital Bonn by a text-based transformer. The IDAC can therefore be a valuable tool for researchers, companies or clinics aiming to develop accurate and reliable DDSS from routine clinical data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。