无需训练,用扩散模型直接从少量X光片重建3D CT,还能扩展到多种医学图像修复任务。
From Sparse X-rays to 3D CT: Training-Free Reconstruction with Diffusion Priors

- 用冻结的3D扩散模型加任务特定正向算子实现无训练逆问题求解
- 在LIDC-IDRI数据集上,1~12张输入X光片均能重建,视图越多效果越好
- 同一模型可通用处理CT重建、超分辨率、补全和去模糊,无需重新训练
解决3D医学逆问题通常需为每种任务和测量设置训练专用监督模型。为打破这一依赖,我们提出TF-PRDiT:一种训练自由的条件采样框架,将固定的体素级3D扩散变换器先验转化为通用医学逆问题求解器。基于扩散逆求解器的后验采样视角,TF-PRDiT通过任务特定前向算子在采样过程中强制测量一致性,而非更新模型权重,使单一预训练先验可复用于多种条件设置。该方法结合预测-校正采样与基于似然的引导,对去噪预测进行稳定的数据保真修正,同时保留底层3D解剖先验。我们在挑战性的X光片到CT重建任务中,集成可微分的DRR投影器,实现梯度从投影空间直接反传至体素,且无需任何重训练。在LIDC-IDRI数据集上的实验表明,TF-PRDiT达到优异重建质量,并能统一处理1~12张输入X光片,性能随视图增加持续提升。除X射线到CT外,仅更换前向算子即可将同一冻结模型扩展至3D超分辨率、体积分块填充和去模糊,无需任务特定重训练,证明单一3D扩散先验可作为体积医学逆问题的通用求解器。
原文摘要 · Abstract (English)
Solving 3D medical inverse problems typically requires training dedicated supervised models for each specific task and measurement setting. To break this dependency, we present TF-PRDiT: a training-free conditional sampling framework that converts a frozen voxel-level 3D Diffusion Transformer prior into a versatile inverse medical problem solver. Building on the posterior-sampling view of diffusion inverse solvers, TF-PRDiT enforces measurement consistency during sampling via a task-specific forward operator rather than updating model weights, enabling a single pretrained prior to be reused across diverse conditional settings. Our method combines a predictor-corrector sampler with likelihood-based guidance on the denoised prediction, providing stable data-fidelity correction while preserving the underlying 3D anatomical prior. We highlight our framework's capability on the challenging task of X-ray-to-CT reconstruction by integrating a differentiable DRR projector to allow gradients to propagate directly from projection space back to voxels without any retraining. Experiments on LIDC-IDRI demonstrate that TF-PRDiT achieves strong reconstruction quality and uniquely scales to an arbitrary number of input X-rays (1-12) under a unified model, with performance improving consistently as additional views are provided. Beyond X-ray-to-CT, we show that simply swapping the forward operator extends the same frozen model to 3D super-resolution, volumetric infilling, and deblurring without any task-specific retraining, demonstrating that a single 3D diffusion prior can serve as a universal solver for volumetric medical inverse problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。