arXiv:2412.13059eess.IVcs.CV2024-12被引 56

3D MedDiffusion可生成高分辨率医学图像,支持多种临床任务。

3D MedDiffusion: A 3D Medical Latent Diffusion Model for Controllable and High-quality Medical Image Generation

  • 用分块体积编码器压缩医学图像,再通过体块解码恢复细节。
  • 能生成512x512x512的高清3D图像,优于现有方法。
  • 适用于CT/MRI重建和分割分类的数据增强,适合医疗AI研究者。

由于医学图像具有高分辨率和三维特性,其生成面临巨大挑战。现有方法在生成高质量3D医学图像方面表现不佳,且缺乏通用生成框架。本文提出3D Medical Latent Diffusion(3D MedDiffusion)模型,实现可控、高质量的3D医学图像生成。该模型采用新型高效分块体积自编码器,通过分块编码将图像压缩至潜在空间,并通过体块解码还原;同时设计新噪声估计器,在扩散去噪过程中捕捉局部细节与全局结构信息。3D MedDiffusion可生成高达512x512x512的精细高分辨率图像,并在覆盖头到腿多个解剖区域的大型多模态数据集(含CT与MRI)上训练,展现出强泛化能力。实验表明,其生成质量优于当前最优方法,在稀疏视图CT重建、快速MRI重建及分割分类数据增强等任务中表现优异。代码与模型权重已开源。

原文摘要 · Abstract (English)

The generation of medical images presents significant challenges due to their high-resolution and three-dimensional nature. Existing methods often yield suboptimal performance in generating high-quality 3D medical images, and there is currently no universal generative framework for medical imaging. In this paper, we introduce a 3D Medical Latent Diffusion (3D MedDiffusion) model for controllable, high-quality 3D medical image generation. 3D MedDiffusion incorporates a novel, highly efficient Patch-Volume Autoencoder that compresses medical images into latent space through patch-wise encoding and recovers back into image space through volume-wise decoding. Additionally, we design a new noise estimator to capture both local details and global structural information during diffusion denoising process. 3D MedDiffusion can generate fine-detailed, high-resolution images (up to 512x512x512) and effectively adapt to various downstream tasks as it is trained on large-scale datasets covering CT and MRI modalities and different anatomical regions (from head to leg). Experimental results demonstrate that 3D MedDiffusion surpasses state-of-the-art methods in generative quality and exhibits strong generalizability across tasks such as sparse-view CT reconstruction, fast MRI reconstruction, and data augmentation for segmentation and classification. Source code and checkpoints are available at https://github.com/ShanghaiTech-IMPACT/3D-MedDiffusion.

3D生成医学图像扩散模型数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。