arXiv:2507.13146eess.IVcs.CV2025-07被引 5

用2步完成3D健康组织修复,速度比现有方法快800倍。

fastWDM3D: Fast and Accurate 3D Healthy Tissue Inpainting

  • 结合扩散模型与波浪分解,用极简步骤实现高质量修复。
  • 仅用2步即达SSIM 0.857、MSE 0.0079,每图处理仅1.81秒。
  • 无需对抗训练,适合医疗影像快速重建与肿瘤模拟研究。

健康组织修复在肿瘤生长建模和图像配准中具有重要应用。以往的脑肿瘤分割挑战赛中,去噪扩散概率模型(DDPM)虽效果良好,但采样速度慢。本文将2D生成方法适配至3D,融合DDPM与生成对抗网络(GAN),并采用方差保持噪声调度,用于3D修复任务。实验表明,该噪声调度与选定重构损失可在少步数下实现高质量3D修复,且无需对抗训练。在此基础上,我们将其应用于无GAN结构的3D小波扩散模型(WDM3D),得到fastWDM3D模型,在BraTS测试集上取得SSIM 0.8571、MSE 0.0079、PSNR 22.26,仅用2个时间步,单图处理时间仅1.81秒。相比其他用于脑组织修复的DDPM,本模型最快提升800倍,性能更优。代码已开源。

原文摘要 · Abstract (English)

Healthy tissue inpainting has significant applications, including the generation of pseudo-healthy baselines for tumor growth models and the facilitation of image registration. In previous editions of the BraTS Local Synthesis of Healthy Brain Tissue via Inpainting Challenge, denoising diffusion probabilistic models (DDPMs) demonstrated qualitatively convincing results but suffered from low sampling speed. To mitigate this limitation, we adapted a 2D image generation approach, combining DDPMs with generative adversarial networks (GANs) and employing a variance-preserving noise schedule, for the task of 3D inpainting. Our experiments showed that the variance-preserving noise schedule and the selected reconstruction losses can be effectively utilized for high-quality 3D inpainting in a few time steps without requiring adversarial training. We applied our findings to a different architecture, a 3D wavelet diffusion model (WDM3D) that does not include a GAN component. The resulting model, denoted as fastWDM3D, obtained a SSIM of 0.8571, a MSE of 0.0079, and a PSNR of 22.26 on the BraTS inpainting test set. Remarkably, it achieved these scores using only two time steps, completing the 3D inpainting process in 1.81 s per image. When compared to other DDPMs used for healthy brain tissue inpainting, our model is up to 800 x faster while still achieving superior performance metrics. Our proposed method, fastWDM3D, represents a promising approach for fast and accurate healthy tissue inpainting. Our code is available at https://github.com/AliciaDurrer/fastWDM3D.

3D修复扩散模型医学图像加速生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。