arXiv:2509.22394eess.IVcs.AI2025-09

用解剖特征损失提升跨模态医学图像合成精度

Deep Learning-Based Cross-Anatomy CT Synthesis Using Adapted nnResU-Net with Anatomical Feature Prioritized Loss

  • 基于nnUNet改进的残差网络+解剖特征优先损失
  • 骨结构和病灶重建更清晰,尤其在MR到CT中
  • 适合需高保真图像合成的医疗影像研究者

我们提出一种基于patch的3D nnUNet改进方法,用于多中心SynthRAD2025数据集上的磁共振(MR)到计算机断层扫描(CT)、锥形束CT(CBCT)到CT图像转换,覆盖头颈部(HN)、胸腔(TH)和腹部(AB)区域。采用标准UNet与残差UNet两种结构,均基于nnUNet适配图像合成任务。引入解剖特征优先(AFP)损失,通过在TotalSegmentator标签上训练的紧凑分割网络提取多层特征进行比对,增强临床相关结构的重建。输入图像按病例进行zscore归一化(MRI),CBCT与CT则采用截断加数据集级zscore归一化。训练使用针对各解剖区域定制的3D patch,无额外数据增强。模型分别训练1000与1500轮,随后用组合L1+AFP目标进行500轮细调。推理时采用步长0.3的重叠patch平均聚合,并执行逆zscore归一化后处理。两种网络结构均应用于所有区域,结合残差学习与AFP损失实现一致设计与局部适应。定性与定量评估显示,残差网络配合AFP损失在骨结构(如MR→CT)与病灶(如CBCT→CT)重建中表现更优,虽仅用L1损失的模型在强度指标上略胜,但整体提供稳定高效的跨模态图像合成方案。

原文摘要 · Abstract (English)

We present a patch-based 3D nnUNet adaptation for MR to CT and CBCT to CT image translation using the multicenter SynthRAD2025 dataset, covering head and neck (HN), thorax (TH), and abdomen (AB) regions. Our approach leverages two main network configurations: a standard UNet and a residual UNet, both adapted from nnUNet for image synthesis. The Anatomical Feature-Prioritized (AFP) loss was introduced, which compares multilayer features extracted from a compact segmentation network trained on TotalSegmentator labels, enhancing reconstruction of clinically relevant structures. Input volumes were normalized per-case using zscore normalization for MRIs, and clipping plus dataset level zscore normalization for CBCT and CT. Training used 3D patches tailored to each anatomical region without additional data augmentation. Models were trained for 1000 and 1500 epochs, with AFP fine-tuning performed for 500 epochs using a combined L1+AFP objective. During inference, overlapping patches were aggregated via mean averaging with step size of 0.3, and postprocessing included reverse zscore normalization. Both network configurations were applied across all regions, allowing consistent model design while capturing local adaptations through residual learning and AFP loss. Qualitative and quantitative evaluation revealed that residual networks combined with AFP yielded sharper reconstructions and improved anatomical fidelity, particularly for bone structures in MR to CT and lesions in CBCT to CT, while L1only networks achieved slightly better intensity-based metrics. This methodology provides a stable solution for cross modality medical image synthesis, demonstrating the effectiveness of combining the automatic nnUNet pipeline with residual learning and anatomically guided feature losses.

图像合成医学影像残差网络解剖先验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。