一个模型搞定多种医学图像修复,效果更准更清晰。
All-in-One Medical Image Restoration with Latent Diffusion-Enhanced Vector-Quantized Codebook Prior
- 用可自适应的代码本库整合不同任务的高清先验特征
- 引入潜在扩散机制迭代优化特征分布,提升修复精度
- 在三种医学图像任务中均表现领先,适合临床多模态应用
全功能医学图像修复(MedIR)旨在使用统一模型同时恢复多种高质量(HQ)医学图像(如MRI、CT和PET)从低质量(LQ)输入。然而,由于不同任务间差异大,每项任务具有独特的退化模式,导致LQ图像信息丢失各异,现有方法难以有效应对。为此,本文提出一种潜在扩散增强的向量量化代码本先验,构建了名为DiffCode的新框架。通过构建任务自适应代码本库,整合跨任务的高清先验特征,实现全面先验建模;并引入潜在扩散策略,利用扩散模型强大的映射能力迭代优化潜在特征分布,在修复过程中估计更准确的高清先验特征。该方法在三个任务——MRI超分辨率、CT去噪与PET合成——上均取得优异的定量指标与视觉质量表现。
原文摘要 · Abstract (English)
All-in-one medical image restoration (MedIR) aims to address multiple MedIR tasks using a unified model, concurrently recovering various high-quality (HQ) medical images (e.g., MRI, CT, and PET) from low-quality (LQ) counterparts. However, all-in-one MedIR presents significant challenges due to the heterogeneity across different tasks. Each task involves distinct degradations, leading to diverse information losses in LQ images. Existing methods struggle to handle these diverse information losses associated with different tasks. To address these challenges, we propose a latent diffusion-enhanced vector-quantized codebook prior and develop \textbf{DiffCode}, a novel framework leveraging this prior for all-in-one MedIR. Specifically, to compensate for diverse information losses associated with different tasks, DiffCode constructs a task-adaptive codebook bank to integrate task-specific HQ prior features across tasks, capturing a comprehensive prior. Furthermore, to enhance prior retrieval from the codebook bank, DiffCode introduces a latent diffusion strategy that utilizes the diffusion model's powerful mapping capabilities to iteratively refine the latent feature distribution, estimating more accurate HQ prior features during restoration. With the help of the task-adaptive codebook bank and latent diffusion strategy, DiffCode achieves superior performance in both quantitative metrics and visual quality across three MedIR tasks: MRI super-resolution, CT denoising, and PET synthesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。