用随机掩码提升PET图像重建质量,兼顾细节与效率。
Diffusion Transformer Meets Random Masks: An Advanced PET Reconstruction Framework
- 将随机掩码引入正弦图与潜在空间,双域协同增强重建
- 采用分层掩码策略,先局部后全局,提升细节与上下文平衡
- 结合紧凑先验加速扩散过程,降低计算开销,适合临床应用
深度学习显著推动了正电子发射断层成像(PET)图像重建,通过直接在投影数据(sinogram)或图像数据上训练,实现了图像质量的显著提升。传统方法常使用掩码进行图像修复任务,但将其引入PET重建框架具有变革性潜力。本文提出一种先进PET重建框架——扩散变换器融合随机掩码(DREAM)。据我们所知,这是首个将掩码机制同时应用于正弦图域和潜在空间的Work,开创了其在PET重建中的应用,并验证了其提升重建保真度与效率的能力。框架采用高维堆叠方法,将二维掩码数据扩展至三维,扩大解空间,使模型捕捉更丰富的空间关系。此外,设计了掩码驱动的潜在空间,利用正弦图与掩码驱动的紧凑先验,加速扩散过程,降低计算复杂度,同时保留关键数据特征。引入分层掩码策略,引导模型从早期关注细粒度局部细节,逐步转向捕捉整体全局模式,实现细节与上下文理解的平衡。实验结果表明,DREAM不仅提升了重建图像的整体质量,还有效保留了关键临床细节,展现了推动PET成像技术发展的潜力。通过整合紧凑先验与分层掩码,DREAM为未来研究与应用提供了高效可行的新路径。开源代码已发布:https://github.com/yqx7150/DREAM。
原文摘要 · Abstract (English)
Deep learning has significantly advanced PET image re-construction, achieving remarkable improvements in image quality through direct training on sinogram or image data. Traditional methods often utilize masks for inpainting tasks, but their incorporation into PET reconstruction frameworks introduces transformative potential. In this study, we pro-pose an advanced PET reconstruction framework called Diffusion tRansformer mEets rAndom Masks (DREAM). To the best of our knowledge, this is the first work to integrate mask mechanisms into both the sinogram domain and the latent space, pioneering their role in PET reconstruction and demonstrating their ability to enhance reconstruction fidelity and efficiency. The framework employs a high-dimensional stacking approach, transforming masked data from two to three dimensions to expand the solution space and enable the model to capture richer spatial rela-tionships. Additionally, a mask-driven latent space is de-signed to accelerate the diffusion process by leveraging sinogram-driven and mask-driven compact priors, which reduce computational complexity while preserving essen-tial data characteristics. A hierarchical masking strategy is also introduced, guiding the model from focusing on fi-ne-grained local details in the early stages to capturing broader global patterns over time. This progressive ap-proach ensures a balance between detailed feature preservation and comprehensive context understanding. Experimental results demonstrate that DREAM not only improves the overall quality of reconstructed PET images but also preserves critical clinical details, highlighting its potential to advance PET imaging technology. By inte-grating compact priors and hierarchical masking, DREAM offers a promising and efficient avenue for future research and application in PET imaging. The open-source code is available at: https://github.com/yqx7150/DREAM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。