arXiv:2409.02070eess.IVcs.CV2024-09被引 10

用可微分切片直接从2D医学图像优化心脏网格,精度更高且更贴近真实临床数据。

Explicit Differentiable Slicing and Global Deformation for Cardiac Mesh Reconstruction

  • 提出可微分体素化与切片算法,让2D图像损失能反向传播到3D网格优化
  • 在多数据集上实现90%的平均骰率,优于现有方法,尤其适用于稀疏噪声图像
  • 适合需要高精度心脏建模的临床研究与生物力学仿真场景

从医学影像重建心脏解剖结构网格有助于形状与运动测量及生物物理仿真,以评估心脏功能与健康。然而,3D医学图像通常以稀疏采样的2D切片形式获取,且含噪声,基于此类数据的网格重建极具挑战。传统体素方法依赖前后处理,损害图像保真度;而网格级深度学习方法需难以获得的网格标注。因此,从2D图像到网格的直接跨域监督是推动医学图像3D学习的关键技术,但尚未充分发展。尽管已有尝试近似优化网格的切片,但很少有方法能以可微方式直接利用2D切片监督网格重建。本文提出一种新颖的显式可微分体素化与切片(DVS)算法,支持从切片到网格的梯度反传,使网格优化可直接由2D图像定义的损失驱动。此外,我们设计了一种结合图谐波形变(GHD)描述符的框架,从医学图像中提取患者特异性左心室(LV)网格,该方法在优化过程中自然保持网格质量与平滑性。实验表明,本方法在CT和MRI数据上的心脏网格重建任务中达到当前最优性能,多数据集整体骰率(Dice score)达90%,显著优于现有方法。该方法还可准确量化射血分数与全局心肌应变等临床参数,与真实值高度吻合,在稀疏图像中表现超越传统体素方法。

原文摘要 · Abstract (English)

Mesh reconstruction of the cardiac anatomy from medical images is useful for shape and motion measurements and biophysics simulations to facilitate the assessment of cardiac function and health. However, 3D medical images are often acquired as 2D slices that are sparsely sampled and noisy, and mesh reconstruction on such data is a challenging task. Traditional voxel-based approaches rely on pre- and post-processing that compromises image fidelity, while mesh-level deep learning approaches require mesh annotations that are difficult to get. Therefore, direct cross-domain supervision from 2D images to meshes is a key technique for advancing 3D learning in medical imaging, but it has not been well-developed. While there have been attempts to approximate the optimized meshes' slicing, few existing methods directly use 2D slices to supervise mesh reconstruction in a differentiable manner. Here, we propose a novel explicit differentiable voxelization and slicing (DVS) algorithm that allows gradient backpropagation to a mesh from its slices, facilitating refined mesh optimization directly supervised by the losses defined on 2D images. Further, we propose an innovative framework for extracting patient-specific left ventricle (LV) meshes from medical images by coupling DVS with a graph harmonic deformation (GHD) mesh morphing descriptor of cardiac shape that naturally preserves mesh quality and smoothness during optimization. Experimental results demonstrate that our method achieves state-of-the-art performance in cardiac mesh reconstruction tasks from CT and MRI, with an overall Dice score of 90% on multi-datasets, outperforming existing approaches. The proposed method can further quantify clinically useful parameters such as ejection fraction and global myocardial strains, closely matching the ground truth and surpassing the traditional voxel-based approach in sparse images.

心脏建模可微分切片网格优化医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。