arXiv:2412.02589cs.CV2024-12被引 4

用稀疏术中数据实时重建心脏4D动态,支持2D切片和1D信号输入。

MedTet: An Online Motion Model for 4D Heart Reconstruction

  • 基于可变形四面体网格与距离值,实现高精度3D运动建模。
  • 从全3D影像到1D信号均能生成解剖一致的3D运动重建。
  • 适用于术中多模态成像,对心脏手术导航有实用价值。

我们提出一种新方法,从稀疏的术中数据重建3D心脏运动。现有方法虽能从完整的3D体数据准确重建器官几何结构,但无法在手术中实时应用,因术中通常仅能获取少量2D图像帧或1D信号。我们设计了一个通用框架,可从这些不完整数据中重建3D运动。该方法将3D空间离散为可变形四面体网格,并使用带符号距离值表示,实现隐式无限分辨率的同时保持对运动动力学的显式控制。在预手术全体积数据重建的初始3D模型基础上,系统通过通用观测编码器,可从完整3D体积、少量2D MRI切片甚至1D信号中重构出连贯的3D心脏运动。在心脏介入场景中的大量实验表明,本方法能从多种稀疏实时观测中生成合理且解剖一致的3D运动重建,凸显其在多模态心脏成像中的潜力。代码与模型将公开于 https://github.com/Scalsol/MedTet。

原文摘要 · Abstract (English)

We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data. While existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging, they cannot be used during surgical interventions where usually limited observed data, such as a few 2D frames or 1D signals, is available in real-time. We propose a versatile framework for reconstructing 3D motion from such partial data. It discretizes the 3D space into a deformable tetrahedral grid with signed distance values, providing implicit unlimited resolution while maintaining explicit control over motion dynamics. Given an initial 3D model reconstructed from pre-operative full volumetric data, our system, equipped with an universal observation encoder, can reconstruct coherent 3D cardiac motion from full 3D volumes, a few 2D MRI slices or even 1D signals. Extensive experiments on cardiac intervention scenarios demonstrate our ability to generate plausible and anatomically consistent 3D motion reconstructions from various sparse real-time observations, highlighting its potential for multimodal cardiac imaging. Our code and model will be made available at https://github.com/Scalsol/MedTet.

心脏重建4D成像稀疏观测术中导航

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。