改进扩散模型,高效生成带结节的肺部CT图像。
Lung-DDPM+: Efficient Thoracic CT Image Synthesis using Diffusion Probabilistic Model
- 用结节语义布局引导扩散过程,聚焦病变区域。
- 采样速度提升14倍,计算量降低8倍,显存减少6.8倍。
- 生成图像质量高,适合医学影像数据增强与病灶合成。
生成式人工智能在多个领域发挥重要作用。利用其生成高质量、多样化的合成数据能力,广泛应用于肺癌诊断等任务中,如基于计算机断层扫描(CT)的诊断。然而,现有用于肺癌诊断的生成模型存在效率低下和解剖结构不精确的问题,限制了其临床应用。为此,我们提出Lung-DDPM+,即先前模型Lung-DDPM的改进版本。该方法是一种由结节语义布局引导的去噪扩散概率模型(DDPM),并由肺部DPM求解器加速,使模型能够聚焦于病灶区域,同时在采样效率与生成质量之间取得更好平衡。在公开的LIDC-IDRI数据集上的评估结果显示,相比Lung-DDPM,所提方法实现8×更少的浮点运算量(FLOPs)、6.8×更低的GPU内存消耗,以及14×更快的采样速度。此外,在两个下游分割任务中,其生成样本质量与Lung-DDPM及其他最先进(SOTA)生成模型相当。我们还邀请资深放射科医师进行了视觉图灵测试,结果表明该方法生成样本具有高度真实性和保真度。实验结果表明,Lung-DDPM+能有效生成带有肺结节的高质量胸腔CT图像,展现出在肿瘤泛化合成和医学影像病灶生成中的广阔应用潜力。代码与预训练模型已开源:https://github.com/Manem-Lab/Lung-DDPM-PLUS。
原文摘要 · Abstract (English)
Generative artificial intelligence (AI) has been playing an important role in various domains. Leveraging its high capability to generate high-fidelity and diverse synthetic data, generative AI is widely applied in diagnostic tasks, such as lung cancer diagnosis using computed tomography (CT). However, existing generative models for lung cancer diagnosis suffer from low efficiency and anatomical imprecision, which limit their clinical applicability. To address these drawbacks, we propose Lung-DDPM+, an improved version of our previous model, Lung-DDPM. This novel approach is a denoising diffusion probabilistic model (DDPM) guided by nodule semantic layouts and accelerated by a pulmonary DPM-solver, enabling the method to focus on lesion areas while achieving a better trade-off between sampling efficiency and quality. Evaluation results on the public LIDC-IDRI dataset suggest that the proposed method achieves 8$\times$ fewer FLOPs (floating point operations per second), 6.8$\times$ lower GPU memory consumption, and 14$\times$ faster sampling compared to Lung-DDPM. Moreover, it maintains comparable sample quality to both Lung-DDPM and other state-of-the-art (SOTA) generative models in two downstream segmentation tasks. We also conducted a Visual Turing Test by an experienced radiologist, showing the advanced quality and fidelity of synthetic samples generated by the proposed method. These experimental results demonstrate that Lung-DDPM+ can effectively generate high-quality thoracic CT images with lung nodules, highlighting its potential for broader applications, such as general tumor synthesis and lesion generation in medical imaging. The code and pretrained models are available at https://github.com/Manem-Lab/Lung-DDPM-PLUS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。