arXiv:2504.09182eess.IVcs.CV2025-04被引 5

用解剖结构生成高质量跨模态医学影像,提升数据合成与人工智能应用能力。

seg2med: a bridge from artificial anatomy to multimodal medical images

  • 基于真实、数字和合成解剖数据构建结构先验,驱动多模态影像生成。
  • 生成的CT和MR图像在结构相似性上分别达到0.94和0.89,器官分割精度超过0.90。
  • 适合用于医学影像数据增强、模型训练及解剖结构敏感的AI研究。

我们提出seg2med,一个以解剖结构为导向的多模态医学图像合成模块化框架。系统集成三部分:首先,从真实患者数据、XCAT数字幻影和多患者器官组合的合成解剖中独立获取解剖图;其次,引入PhysioSynth,一种模态特异性模拟器,利用组织依赖参数(如HU、T1、T2、质子密度)和模态特异性信号模型,将解剖掩码转换为先验体积,支持CT及多种MR序列(GRE、SPACE、VIBE)模拟;第三,使用合成的解剖先验训练双通道条件去噪扩散模型,以解剖先验作为结构约束,生成高质量且结构对齐的图像。该框架在真实数据上的结构相似性(SSIM)达0.94(CT)和0.89(MR),模拟CT的特征相似性(FSIM)为0.78,CT合成的弗雷切特初始距离(FID)为3.62。在模态转换中,实现MR到CT的SSIM为0.91,CT到MR为0.77。解剖保真度评估显示,合成CT在11个关键腹部器官上平均骰子系数(Dice)高于0.90,59个器官中有34个高于0.80。结果表明,seg2med在跨模态合成、数据增强和解剖感知医学人工智能中具有重要价值。

原文摘要 · Abstract (English)

We present seg2med, a modular framework for anatomy-driven multimodal medical image synthesis. The system integrates three components to enable high-fidelity, cross-modality generation of CT and MR images based on structured anatomical priors. First, anatomical maps are independently derived from three sources: real patient data, XCAT digital phantoms, and synthetic anatomies created by combining organs from multiple patients. Second, we introduce PhysioSynth, a modality-specific simulator that converts anatomical masks into prior volumes using tissue-dependent parameters (e.g., HU, T1, T2, proton density) and modality-specific signal models. It supports simulation of CT and multiple MR sequences including GRE, SPACE, and VIBE. Third, the synthesized anatomical priors are used to train 2-channel conditional denoising diffusion models, which take the anatomical prior as structural condition alongside the noisy image, enabling generation of high-quality, structurally aligned images. The framework achieves SSIM of 0.94 for CT and 0.89 for MR compared to real data, and FSIM of 0.78 for simulated CT. The generative quality is further supported by a Frechet Inception Distance (FID) of 3.62 for CT synthesis. In modality conversion, seg2med achieves SSIM of 0.91 for MR to CT and 0.77 for CT to MR. Anatomical fidelity evaluation shows synthetic CT achieves mean Dice scores above 0.90 for 11 key abdominal organs, and above 0.80 for 34 of 59 total organs. These results underscore seg2med's utility in cross-modality synthesis, data augmentation, and anatomy-aware medical AI.

医学影像扩散模型数据生成解剖结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。