arXiv:2409.09370eess.IVcs.CV2024-09NeurIPS被引 4

用2D网络估计3D MRI运动,实时修正患者移动导致的图像失真。

MotionTTT: 2D Test-Time-Training Motion Estimation for 3D Motion Corrected MRI

  • 通过测试时训练,利用重建网络的损失变化反推运动参数。
  • 在真实和模拟数据上均实现高精度3D刚性运动估计与图像校正。
  • 首个基于深度学习的3D刚性运动估计方法,适合临床MRI质量提升。

磁共振成像(MRI)因扫描时间长,患者运动常导致严重伪影。本文提出一种基于深度学习的测试时训练方法,用于精确运动估计。核心思想是:经过无运动重建训练的神经网络,在无运动时损失最小,通过优化传入重建网络的运动参数,可准确估计运动。所估运动参数用于图像校正,实现高质量重建。该方法使用2D重建网络估计3D刚性运动,是首个面向3D运动校正MRI的深度学习运动估计方法。我们证明了其在简单信号与神经网络模型下的参数可重构性,并在回溯模拟运动与前瞻性采集的真实运动污染数据上验证了有效性。

原文摘要 · Abstract (English)

A major challenge of the long measurement times in magnetic resonance imaging (MRI), an important medical imaging technology, is that patients may move during data acquisition. This leads to severe motion artifacts in the reconstructed images and volumes. In this paper, we propose a deep learning-based test-time-training method for accurate motion estimation. The key idea is that a neural network trained for motion-free reconstruction has a small loss if there is no motion, thus optimizing over motion parameters passed through the reconstruction network enables accurate estimation of motion. The estimated motion parameters enable to correct for the motion and to reconstruct accurate motion-corrected images. Our method uses 2D reconstruction networks to estimate rigid motion in 3D, and constitutes the first deep learning based method for 3D rigid motion estimation towards 3D-motion-corrected MRI. We show that our method can provably reconstruct motion parameters for a simple signal and neural network model. We demonstrate the effectiveness of our method for both retrospectively simulated motion and prospectively collected real motion-corrupted data.

MRI运动校正深度学习测试时训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。