arXiv:2604.12152cs.CVcs.AI2026-04

用医学图像专用的自编码器,让扩散模型生成更清晰的医学影像。

Domain-Specific Latent Representations Improve the Fidelity of Diffusion-Based Medical Image Super-Resolution

论文配图:Domain-Specific Latent Representations Improve the Fidelity of Diffusion-Based Medical Image Super-Resolution
图 1 · 摘自论文原文
  • 改用专为医学图像训练的自编码器MedVAE替代通用模型。
  • 在三种医学影像上提升2.91到3.29 dB的重建质量。
  • 适合关注图像保真度的医疗影像超分辨率研究者。

用于医学图像超分辨率的潜在扩散模型普遍沿用为自然照片设计的变分自编码器(VAE)。我们发现,这一默认选择而非扩散架构,是制约重建质量的主要因素。在保持其他组件不变的对照实验中,将通用的Stable Diffusion VAE替换为在超过160万张医学图像上预训练的MedVAE,使膝关节MRI、脑部MRI和胸部X光片的峰值信噪比(PSNR)提升2.91至3.29 dB(n = 1,820;Cohen's d = 1.37 至 1.86,所有p < 10^{-20},Wilcoxon符号秩检验)。小波分解表明优势集中在编码解剖学关键细节的最细空间频率带。对推理调度、预测目标和生成架构的消融实验确认该差距稳定在±0.15 dB以内,且幻觉率与原方法相当(所有数据集Cohen's h < 0.02),证明重建保真度与生成幻觉由独立组件控制。结果提供实用筛选标准:自编码器的重建质量可无须扩散训练即可预测下游超分辨率性能(R^2 = 0.67),建议优先选择领域专用的VAE再优化扩散架构。代码与训练权重已公开于https://github.com/sebasmos/latent-sr。

原文摘要 · Abstract (English)

Latent diffusion models for medical image super-resolution universally inherit variational autoencoders designed for natural photographs. We show that this default choice, not the diffusion architecture, is the dominant constraint on reconstruction quality. In a controlled experiment holding all other pipeline components fixed, replacing the generic Stable Diffusion VAE with MedVAE, a domain-specific autoencoder pretrained on more than 1.6 million medical images, yields +2.91 to +3.29 dB PSNR improvement across knee MRI, brain MRI, and chest X-ray (n = 1,820; Cohen's d = 1.37 to 1.86, all p < 10^{-20}, Wilcoxon signed-rank). Wavelet decomposition localises the advantage to the finest spatial frequency bands encoding anatomically relevant fine structure. Ablations across inference schedules, prediction targets, and generative architectures confirm the gap is stable within plus or minus 0.15 dB, while hallucination rates remain comparable between methods (Cohen's h < 0.02 across all datasets), establishing that reconstruction fidelity and generative hallucination are governed by independent pipeline components. These results provide a practical screening criterion: autoencoder reconstruction quality, measurable without diffusion training, predicts downstream SR performance (R^2 = 0.67), suggesting that domain-specific VAE selection should precede diffusion architecture search. Code and trained model weights are publicly available at https://github.com/sebasmos/latent-sr.

医学图像超分辨率扩散模型自编码器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。