用双视角引导扩散模型,从少量X光片重建高保真3D CT。
DVG-Diffusion: Dual-View Guided Diffusion Model for CT Reconstruction from X-Rays
- 引入真实与合成双视角图像联合指导重建。
- 在低剂量数据下实现更高保真度与视觉质量的3D CT重建。
- 适合医学影像重建、低剂量CT成像研究者使用。
直接通过端到端深度学习网络从少视角2D X光片重建3D CT体积是一项挑战,因为X光图像是3D CT体积的投影视图。本文提出双视角引导扩散模型(DVG-Diffusion),通过结合新视角合成和视图引导特征对齐来降低学习难度。具体而言,该模型耦合一个真实输入的X光视图和一个合成的新X光视图,共同引导CT重建。首先,设计一种新型视图参数引导编码器,提取与CT空间对齐的特征;随后,将双视图提取的特征拼接作为条件,输入潜空间扩散模型以学习并优化CT潜在表示;最后,将重构的潜变量解码为像素空间中的CT体积。通过引入视图参数引导编码与双视角引导重建机制,DVG-Diffusion 在重建保真度与视觉质量之间实现了有效平衡。实验表明,该方法优于现有最先进方法。文中还提供了关于视图选择与重建性能的综合分析与讨论。
原文摘要 · Abstract (English)
Directly reconstructing 3D CT volume from few-view 2D X-rays using an end-to-end deep learning network is a challenging task, as X-ray images are merely projection views of the 3D CT volume. In this work, we facilitate complex 2D X-ray image to 3D CT mapping by incorporating new view synthesis, and reduce the learning difficulty through view-guided feature alignment. Specifically, we propose a dual-view guided diffusion model (DVG-Diffusion), which couples a real input X-ray view and a synthesized new X-ray view to jointly guide CT reconstruction. First, a novel view parameter-guided encoder captures features from X-rays that are spatially aligned with CT. Next, we concatenate the extracted dual-view features as conditions for the latent diffusion model to learn and refine the CT latent representation. Finally, the CT latent representation is decoded into a CT volume in pixel space. By incorporating view parameter guided encoding and dual-view guided CT reconstruction, our DVG-Diffusion can achieve an effective balance between high fidelity and perceptual quality for CT reconstruction. Experimental results demonstrate our method outperforms state-of-the-art methods. Based on experiments, the comprehensive analysis and discussions for views and reconstruction are also presented.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。