无需标注数据,用深度学习重建高分辨率胎儿脑部MRI。
SUFFICIENT: A scan-specific unsupervised deep learning framework for high-resolution 3D isotropic fetal brain MRI reconstruction
- 用神经网络自动对齐2D切片与3D体积,实现无监督运动校正。
- 在真实临床数据上重建出各向同性高分辨率胎儿脑图像,优于现有方法。
- 适合缺乏标注数据的医学影像重建任务,尤其适用于胎儿磁共振成像。
从运动伪影严重的2D切片中重建高质量3D胎儿脑部MRI对临床诊断至关重要。可靠的切片到体积分组(SVR)运动校正与超分辨率重建(SRR)方法必不可少。深度学习在提升SVR和SRR方面表现优于传统方法,但需大规模外部训练数据,而临床胎儿MRI难以获取此类数据。为此,本文提出一种针对特定扫描的无监督迭代式SVR-SRR框架,用于各向同性高分辨率(HR)体积重建。具体而言,将SVR建模为一个函数,将2D切片与3D目标体积映射为刚性变换矩阵,以对齐切片至目标体积中的对应位置。该函数由卷积神经网络参数化,并通过最小化预测切片与输入切片之间的差异进行训练。在SRR中,引入嵌入于深度图像先验框架中的解码网络,结合全面的图像退化模型生成高分辨率体积。深度图像先验提供局部一致性先验,指导高分辨率体积重建。通过前向退化模型,优化高分辨率体积,使预测切片与观测切片间损失最小。在大运动伪影模拟数据和临床数据上的综合实验表明,所提框架在性能上显著优于当前最先进的胎儿脑部重建方法。
原文摘要 · Abstract (English)
High-quality 3D fetal brain MRI reconstruction from motion-corrupted 2D slices is crucial for clinical diagnosis. Reliable slice-to-volume registration (SVR)-based motion correction and super-resolution reconstruction (SRR) methods are essential. Deep learning (DL) has demonstrated potential in enhancing SVR and SRR when compared to conventional methods. However, it requires large-scale external training datasets, which are difficult to obtain for clinical fetal MRI. To address this issue, we propose an unsupervised iterative SVR-SRR framework for isotropic HR volume reconstruction. Specifically, SVR is formulated as a function mapping a 2D slice and a 3D target volume to a rigid transformation matrix, which aligns the slice to the underlying location in the target volume. The function is parameterized by a convolutional neural network, which is trained by minimizing the difference between the volume slicing at the predicted position and the input slice. In SRR, a decoding network embedded within a deep image prior framework is incorporated with a comprehensive image degradation model to produce the high-resolution (HR) volume. The deep image prior framework offers a local consistency prior to guide the reconstruction of HR volumes. By performing a forward degradation model, the HR volume is optimized by minimizing loss between predicted slices and the observed slices. Comprehensive experiments conducted on large-magnitude motion-corrupted simulation data and clinical data demonstrate the superior performance of the proposed framework over state-of-the-art fetal brain reconstruction frameworks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。