arXiv:2507.00206eess.IVcs.CV2025-07

用3D语义图生成医学图像,保护隐私还增数据。

Towards 3D Semantic Image Synthesis for Medical Imaging

  • 在预训练VQ-GAN的潜空间中用扩散模型生成3D图像
  • 在杜克乳腺数据集上3D-FID达0.0054,分割精度接近真实数据
  • 适合需要完整体积数据的医疗影像生成与隐私保护场景

医疗影像领域因数据获取难和隐私法规严,难以获得大规模数据。为此,本文提出Med-LSDM(潜空间语义扩散模型),直接在3D域生成合成数据,以保护隐私并实现数据增强。不同于多数仅生成2D切片的方法,Med-LSDM专为3D语义图像合成设计,适用于需完整体数据的应用。该模型利用预训练VQ-GAN的潜空间,通过扩散机制控制生成过程,在降低计算复杂度的同时保留关键3D空间细节。在条件杜克乳腺数据集上,模型达到3D-FID 0.0054,Dice分数为0.70964,接近真实图像的0.71496,表明合成数据与真实数据间域差距小,具备实用的数据增强价值。

原文摘要 · Abstract (English)

In the medical domain, acquiring large datasets is challenging due to both accessibility issues and stringent privacy regulations. Consequently, data availability and privacy protection are major obstacles to applying machine learning in medical imaging. To address this, our study proposes the Med-LSDM (Latent Semantic Diffusion Model), which operates directly in the 3D domain and leverages de-identified semantic maps to generate synthetic data as a method of privacy preservation and data augmentation. Unlike many existing methods that focus on generating 2D slices, Med-LSDM is designed specifically for 3D semantic image synthesis, making it well-suited for applications requiring full volumetric data. Med-LSDM incorporates a guiding mechanism that controls the 3D image generation process by applying a diffusion model within the latent space of a pre-trained VQ-GAN. By operating in the compressed latent space, the model significantly reduces computational complexity while still preserving critical 3D spatial details. Our approach demonstrates strong performance in 3D semantic medical image synthesis, achieving a 3D-FID score of 0.0054 on the conditional Duke Breast dataset and similar Dice scores (0.70964) to those of real images (0.71496). These results demonstrate that the synthetic data from our model have a small domain gap with real data and are useful for data augmentation.

3D生成医学影像隐私保护扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。