用超声生成核磁图像,提升前列腺癌诊断准确率。
Influence of High-Performance Image-to-Image Translation Networks on Clinical Visual Assessment and Outcome Prediction: Utilizing Ultrasound to MRI Translation in Prostate Cancer
- 用2D-Pix2Pix网络将超声转为核磁,性能最优。
- 合成图像使分类准确率和AUC达0.93,优于原始超声。
- 适合临床影像医生与医学AI研究者参考。
目的:本研究探讨图像到图像转换(I2I)网络的核心特性,评估其在临床实践中的有效性与适应性。方法:基于794例前列腺癌(PCa)患者数据,采用10种主流2D/3D I2I网络将超声(US)图像转化为核磁共振(MRI)图像,并通过斯皮尔曼相关系数分析放射组学特征(RF),检验高表现网络(SSIM>85%)是否能捕捉细微特征。7位医生对生成图像进行定性评估,进一步比较合成MRI数据在两种传统机器学习与一种深度学习方法上的预测性能。结果:定量分析显示,2D-Pix2Pix网络表现最佳,平均SSIM达0.855。放射组学分析发现,2D-Pix2Pix识别出186个特征中的76个,但半数特征在转换中丢失。7名医生评审指出低层级特征识别能力不足。最终,基于合成图像的分类模型平均准确率与AUC均达到0.93,优于基于原始超声的模型。结论:尽管2D-Pix2Pix在低层级特征发现与整体误差、相似度指标上优于前沿网络,仍需改进低层级特征表现;合成图像可显著提升分类性能。
原文摘要 · Abstract (English)
Purpose: This study examines the core traits of image-to-image translation (I2I) networks, focusing on their effectiveness and adaptability in everyday clinical settings. Methods: We have analyzed data from 794 patients diagnosed with prostate cancer (PCa), using ten prominent 2D/3D I2I networks to convert ultrasound (US) images into MRI scans. We also introduced a new analysis of Radiomic features (RF) via the Spearman correlation coefficient to explore whether networks with high performance (SSIM>85%) could detect subtle RFs. Our study further examined synthetic images by 7 invited physicians. As a final evaluation study, we have investigated the improvement that are achieved using the synthetic MRI data on two traditional machine learning and one deep learning method. Results: In quantitative assessment, 2D-Pix2Pix network substantially outperformed the other 7 networks, with an average SSIM~0.855. The RF analysis revealed that 76 out of 186 RFs were identified using the 2D-Pix2Pix algorithm alone, although half of the RFs were lost during the translation process. A detailed qualitative review by 7 medical doctors noted a deficiency in low-level feature recognition in I2I tasks. Furthermore, the study found that synthesized image-based classification outperformed US image-based classification with an average accuracy and AUC~0.93. Conclusion: This study showed that while 2D-Pix2Pix outperformed cutting-edge networks in low-level feature discovery and overall error and similarity metrics, it still requires improvement in low-level feature performance, as highlighted by Group 3. Further, the study found using synthetic image-based classification outperformed original US image-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。