回归模型比扩散模型更适合作医疗图像转换,速度快且不失真。
Regression is all you need for medical image translation
- 用回归方法一步生成无噪图像,跳过传统迭代过程。
- 在五个医学影像数据集上,效果优于或等同于复杂扩散模型。
- 适合追求高精度、低延迟的临床影像转换场景。
尽管生成对抗网络(GAN)和扩散模型(DM)在自然图像合成中表现优异,但其强调创意与真实感的特性在医疗应用中可能带来幻觉和噪声复制问题。本文提出一种基于2.5D扩散框架的YODA(You Only Denoise once - or Average)方法,发现传统扩散采样会随机重复噪声。为此,我们通过多样本抽样并平均,近似扩散模型的期望值,称为期望逼近(ExpA)采样。进一步提出回归采样:保留初始预测结果,省略迭代优化,一步生成无噪图像。在包括多对比度脑MRI和盆腔MRI-CT在内的五组多模态数据集中,回归采样不仅显著提升效率,且图像质量达到甚至超过完整扩散采样(含ExpA)。下游任务验证表明,迭代优化仅提升感知真实感,不影响信息传递准确性。YODA超越八种先进扩散模型与生成对抗网络,在高质量医疗图像转换中挑战了扩散模型与生成对抗网络的绝对优势。此外,经YODA转换的图像可替代甚至优于实际采集数据,适用于多种临床应用。
原文摘要 · Abstract (English)
While Generative Adversarial Nets (GANs) and Diffusion Models (DMs) have achieved impressive results in natural image synthesis, their core strengths - creativity and realism - can be detrimental in medical applications, where accuracy and fidelity are paramount. These models instead risk introducing hallucinations and replication of unwanted acquisition noise. Here, we propose YODA (You Only Denoise once - or Average), a 2.5D diffusion-based framework for medical image translation (MIT). Consistent with DM theory, we find that conventional diffusion sampling stochastically replicates noise. To mitigate this, we draw and average multiple samples, akin to physical signal averaging. As this effectively approximates the DM's expected value, we term this Expectation-Approximation (ExpA) sampling. We additionally propose regression sampling YODA, which retains the initial DM prediction and omits iterative refinement to produce noise-free images in a single step. Across five diverse multi-modal datasets - including multi-contrast brain MRI and pelvic MRI-CT - we demonstrate that regression sampling is not only substantially more efficient but also matches or exceeds image quality of full diffusion sampling even with ExpA. Our results reveal that iterative refinement solely enhances perceptual realism without benefiting information translation, which we confirm in relevant downstream tasks. YODA outperforms eight state-of-the-art DMs and GANs and challenges the presumed superiority of DMs and GANs over computationally cheap regression models for high-quality MIT. Furthermore, we show that YODA-translated images are interchangeable with, or even superior to, physical acquisitions for several medical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。