无需配对数据,用扩散模型提升低分辨率CT重建细节。
Zero-shot CT Super-Resolution using Diffusion-based 2D Projection Priors and Signed 3D Gaussians
- 用扩散模型增强2D投影信息,弥补3D输入细节不足
- 4倍超分辨率下优于现有方法,专家评估具临床潜力
- 适合无标注数据的医学影像重建场景
计算机断层扫描(CT)在临床诊断中至关重要,但高分辨率(HR)CT受限于辐射风险。基于深度学习的超分辨率(SR)方法虽有潜力,但监督方法需成对数据,通常不可得。零样本方法仅依赖单个低分辨率(LR)输入,但常因信息稀缺而难以恢复细结构。为此,我们提出一种新型零样本3D CT超分辨率框架,将基于扩散的2D投影先验融入3D重建过程。该框架分两阶段:(1)训练扩散模型在大量X光数据上进行低分辨率投影超分辨率,以增强原始输入中稀缺的信息;(2)使用3D高斯点云渲染结合新提出的负α混合(NAB-GS),建模正负高斯密度,学习扩散生成的高分辨率与上采样低分辨率投影之间的符号残差。该方法在两个公开数据集上均表现出更优的定量和定性性能,专家评估显示其在4倍超分辨率下具备显著临床潜力。
原文摘要 · Abstract (English)
Computed tomography (CT) is important in clinical diagnosis, but acquiring high-resolution (HR) CT is constrained by radiation exposure risks. While deep learning-based super-resolution (SR) methods have shown promise for reconstructing HR CT from low-resolution (LR) inputs, supervised approaches require paired datasets that are often unavailable. Zero-shot methods address this limitation by operating on single LR inputs; however, they frequently fail to recover fine structural details due to limited LR information within individual volumes. To overcome these limitations, we propose a novel zero-shot 3D CT SR framework that integrates diffusion-based upsampled 2D projection priors into the 3D reconstruction process. Specifically, our framework consists of two stages: (1) LR CT projection SR, training a diffusion model on abundant X-ray data to upsample LR projections, thereby enhancing the scarce information inherent in the LR inputs. (2) 3D CT volume reconstruction, using 3D Gaussian splatting with our novel Negative Alpha Blending (NAB-GS), which models positive and negative Gaussian densities to learn signed residuals between diffusion-generated HR and upsampled LR projections. Our framework demonstrates superior quantitative and qualitative performance on two public datasets, and expert evaluations present the framework's clinical potential at 4x.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。