用AI把胎儿超声图转成类MRI图像,提升脑部结构辨识度。
Translation of Fetal Brain Ultrasound Images into Pseudo-MRI Images using Artificial Intelligence
- 基于扩散模型构建双域协同翻译框架,共享超声与MRI隐空间
- 在多个指标上优于现有方法,尤其在侧脑室和外侧裂区域对比度提升明显
- 临床医生测试显示81%图像视觉表现改善,适合产科影像辅助诊断
超声是孕期胎儿脑部评估的常用、低成本成像工具,但在孕晚期因脑部结构复杂,对图像质量要求高。相比之下,磁共振成像(MRI)虽提供更优的图像质量和组织分辨能力,但获取困难、成本高且耗时。将超声图像转换为类MRI显示可能有助于更好呈现脑组织解剖结构。为此,本文采用生成式扩散模型,提出名为“双扩散协相关”(DDIC)的方法,假设超声与MRI共享潜在表示空间。模型训练使用超声数据集HC18,以及MRI数据集CRL胎儿脑图谱和FeTA。生成的伪MRI图像显著提升了脑组织的视觉辨别度,尤其在侧脑室和外侧裂区域,对比度清晰度增强。定量评估显示,互信息、峰值信噪比、Fréchet Inception距离及对比噪声比均显著优于其他方法。5位妇产科医生参与的医学意见测试表明,81%的图像显示效果得到改善。结果表明,该伪MRI图像有潜力优化诊断流程,提升临床诊疗效果。
原文摘要 · Abstract (English)
Ultrasound is a widely accessible and cost-effective medical imaging tool commonly used for prenatal evaluation of the fetal brain. However, it has limitations, particularly in the third trimester, where the complexity of the fetal brain requires high image quality for extracting quantitative data. In contrast, magnetic resonance imaging (MRI) offers superior image quality and tissue differentiation but is less available, expensive, and requires time-consuming acquisition. Thus, transforming ultrasonic images into an MRI-mimicking display may be advantageous and allow better tissue anatomy presentation. To address this goal, we have examined the use of artificial intelligence, implementing a diffusion model renowned for generating high-quality images. The proposed method, termed "Dual Diffusion Imposed Correlation" (DDIC), leverages a diffusion-based translation methodology, assuming a shared latent space between ultrasound and MRI domains. Model training was obtained utilizing the "HC18" dataset for ultrasound and the "CRL fetal brain atlas" along with the "FeTA " datasets for MRI. The generated pseudo-MRI images provide notable improvements in visual discrimination of brain tissue, especially in the lateral ventricles and the Sylvian fissure, characterized by enhanced contrast clarity. Improvement was demonstrated in Mutual information, Peak signal-to-noise ratio, Fréchet Inception Distance, and Contrast-to-noise ratio. Findings from these evaluations indicate statistically significant superior performance of the DDIC compared to other translation methodologies. In addition, a Medical Opinion Test was obtained from 5 gynecologists. The results demonstrated display improvement in 81% of the tested images. In conclusion, the presented pseudo-MRI images hold the potential for streamlining diagnosis and enhancing clinical outcomes through improved representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。