不同扫描仪导致的图像差异会显著降低医学AI模型性能,尤其影响MRI。
The Impact of Scanner Domain Shift on Deep Learning Performance in Medical Imaging: an Experimental Study
- 在多种影像模态中测试跨扫描仪性能下降问题
- MRI性能下降最严重,CT影响最小,与设备标准化程度相关
- 增加目标扫描仪数据或加噪声可提升模型泛化能力
目的:使用不同扫描仪和协议获取的医学图像在外观上可能存在显著差异,这种现象称为扫描仪域偏移,会导致在某一扫描仪上训练的深度神经网络在另一扫描仪数据上表现下降。尽管这一问题被广泛认知,但缺乏针对不同模态和诊断任务的系统性研究。方法:本文开展一项广泛的实验研究,评估卷积神经网络在不同自动化诊断任务中受扫描仪域偏移的影响。研究涵盖常见的放射学模态:X射线、CT和MRI。结果:发现模型在不同扫描仪数据上的性能几乎总是低于同扫描仪数据,且量化了各数据集的性能下降程度。值得注意的是,该下降在MRI中最严重,X射线中等,而CT最小,这可能归因于CT设备采集过程的高度标准化,而X射线和MRI则不具备此特性。此外,研究还考察了在训练集中注入不同量的目标域数据以及对训练数据添加噪声对泛化能力的影响。结论:本研究为深度学习在不同模态下因扫描仪域偏移导致的性能下降提供了广泛且量化的实证依据,旨在指导未来鲁棒医学图像分析模型的开发。
原文摘要 · Abstract (English)
Purpose: Medical images acquired using different scanners and protocols can differ substantially in their appearance. This phenomenon, scanner domain shift, can result in a drop in the performance of deep neural networks which are trained on data acquired by one scanner and tested on another. This significant practical issue is well-acknowledged, however, no systematic study of the issue is available across different modalities and diagnostic tasks. Materials and Methods: In this paper, we present a broad experimental study evaluating the impact of scanner domain shift on convolutional neural network performance for different automated diagnostic tasks. We evaluate this phenomenon in common radiological modalities, including X-ray, CT, and MRI. Results: We find that network performance on data from a different scanner is almost always worse than on same-scanner data, and we quantify the degree of performance drop across different datasets. Notably, we find that this drop is most severe for MRI, moderate for X-ray, and quite small for CT, on average, which we attribute to the standardized nature of CT acquisition systems which is not present in MRI or X-ray. We also study how injecting varying amounts of target domain data into the training set, as well as adding noise to the training data, helps with generalization. Conclusion: Our results provide extensive experimental evidence and quantification of the extent of performance drop caused by scanner domain shift in deep learning across different modalities, with the goal of guiding the future development of robust deep learning models for medical image analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。