arXiv:2411.17488eess.IVcs.CV2024-11被引 7

用结构引导生成更准的CT,提升全身PET/MR成像精度

Structure-Guided MR-to-CT Synthesis with Spatial and Semantic Alignments for Attenuation Correction of Whole-Body PET/MR Imaging

  • 引入结构引导注意力门,抑制软组织多余轮廓
  • 通过体积与呼吸运动建模实现图像精准配准
  • 基于对比学习保证器官语义真实,适合医学影像研究

基于深度学习的MR-to-CT合成可估算组织电子密度,从而实现全身PET/MR成像中的衰减校正。然而,全身范围的MR-to-CT合成面临空间错位和强度映射复杂等挑战,主要源于人体组织与器官的多样性。本文提出一种新型全身MR-to-CT合成框架,包含三个新模块:(1) 结构引导生成模块利用结构引导注意力门,通过抑制软组织不必要的轮廓来提升合成图像质量;(2) 空间对齐模块考虑组织体积与呼吸运动影响,实现配对MR与CT图像的精确配准,为训练提供对齐良好的真实CT图像;(3) 语义对齐模块采用对比学习约束器官相关语义信息,确保合成CT图像的语义真实性。大量实验表明,所提框架能生成视觉合理且语义真实的CT图像,并验证其在PET衰减校正中的实用性。

原文摘要 · Abstract (English)

Deep-learning-based MR-to-CT synthesis can estimate the electron density of tissues, thereby facilitating PET attenuation correction in whole-body PET/MR imaging. However, whole-body MR-to-CT synthesis faces several challenges including the issue of spatial misalignment and the complexity of intensity mapping, primarily due to the variety of tissues and organs throughout the whole body. Here we propose a novel whole-body MR-to-CT synthesis framework, which consists of three novel modules to tackle these challenges: (1) Structure-Guided Synthesis module leverages structure-guided attention gates to enhance synthetic image quality by diminishing unnecessary contours of soft tissues; (2) Spatial Alignment module yields precise registration between paired MR and CT images by taking into account the impacts of tissue volumes and respiratory movements, thus providing well-aligned ground-truth CT images during training; (3) Semantic Alignment module utilizes contrastive learning to constrain organ-related semantic information, thereby ensuring the semantic authenticity of synthetic CT images.We conduct extensive experiments to demonstrate that the proposed whole-body MR-to-CT framework can produce visually plausible and semantically realistic CT images, and validate its utility in PET attenuation correction.

医学影像图像合成深度学习PET/MR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。