用MR图像辅助修复低剂量PET,提升图像质量同时减少辐射
Supervise-assisted Multi-modality Fusion Diffusion Model for PET Restoration
- 融合多模态特征,用MR信息指导低剂量PET重建
- 两阶段监督学习,兼顾通用先验与真实数据特异性
- 在真实数据上表现优于现有方法,适合临床影像修复
正电子发射断层扫描(PET)虽具强大功能成像能力,但伴随辐射暴露。降低放射性示踪剂剂量或扫描时间虽可减少辐射,却会损害图像质量。利用结构更清晰的磁共振(MR)图像来从低剂量PET(LPET)恢复标准剂量PET(SPET)是有效途径,但面临多模态融合中结构纹理不一致及分布外(OOD)数据匹配难题。本文提出一种监督辅助的多模态融合扩散模型(MFdiff),以解决上述问题。首先,设计多模态特征融合模块,优化融合特征以充分利用辅助MR图像,避免引入冗余细节;其次,基于融合特征作为条件,通过扩散模型迭代生成高质量SPET图像。此外,采用两阶段监督学习策略,分别利用模拟的分布内数据集中的通用先验和真实体内分布外数据的特定先验。实验表明,所提方法能有效从多模态输入中恢复高质量SPET图像,在定性和定量指标上均优于当前最优方法。
原文摘要 · Abstract (English)
Positron emission tomography (PET) offers powerful functional imaging but involves radiation exposure. Efforts to reduce this exposure by lowering the radiotracer dose or scan time can degrade image quality. While using magnetic resonance (MR) images with clearer anatomical information to restore standard-dose PET (SPET) from low-dose PET (LPET) is a promising approach, it faces challenges with the inconsistencies in the structure and texture of multi-modality fusion, as well as the mismatch in out-of-distribution (OOD) data. In this paper, we propose a supervise-assisted multi-modality fusion diffusion model (MFdiff) for addressing these challenges for high-quality PET restoration. Firstly, to fully utilize auxiliary MR images without introducing extraneous details in the restored image, a multi-modality feature fusion module is designed to learn an optimized fusion feature. Secondly, using the fusion feature as an additional condition, high-quality SPET images are iteratively generated based on the diffusion model. Furthermore, we introduce a two-stage supervise-assisted learning strategy that harnesses both generalized priors from simulated in-distribution datasets and specific priors tailored to in-vivo OOD data. Experiments demonstrate that the proposed MFdiff effectively restores high-quality SPET images from multi-modality inputs and outperforms state-of-the-art methods both qualitatively and quantitatively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。