用文字提示融合解剖信息,提升低剂量PET图像去噪效果。
PET Image Denoising via Text-Guided Diffusion: Integrating Anatomical Priors through Text Prompts
- 通过CLIP模型编码解剖文本,用跨注意力机制引导扩散过程。
- 在全身和器官层面均优于UNet与标准DDPM,提升图像质量。
- 适合需要融合医学先验知识的低剂量PET重建研究者。
低剂量正电子发射断层扫描(PET)因噪声增加和图像质量下降,影响诊断准确性和临床应用。基于扩散概率模型(DDPM)的方法在去噪方面表现良好,但通常忽略患者人口统计学、解剖信息和扫描参数等重要元数据。近期视觉-语言模型(如预训练的CLIP)表明,文本信息可增强视觉任务性能。本初步研究提出一种文本引导的DDPM用于PET去噪,通过文本提示整合解剖先验。使用预训练的CLIP文本编码器提取解剖描述的语义特征,并通过交叉注意力机制融入扩散过程。基于1/20低剂量与正常剂量18F-FDG PET配对数据集的评估显示,该方法在全身和器官水平上均优于传统UNet和标准DDPM。结果表明,利用视觉-语言模型将丰富元数据融入扩散框架,可有效提升低剂量PET图像质量。
原文摘要 · Abstract (English)
Low-dose Positron Emission Tomography (PET) imaging presents a significant challenge due to increased noise and reduced image quality, which can compromise its diagnostic accuracy and clinical utility. Denoising diffusion probabilistic models (DDPMs) have demonstrated promising performance for PET image denoising. However, existing DDPM-based methods typically overlook valuable metadata such as patient demographics, anatomical information, and scanning parameters, which should further enhance the denoising performance if considered. Recent advances in vision-language models (VLMs), particularly the pre-trained Contrastive Language-Image Pre-training (CLIP) model, have highlighted the potential of incorporating text-based information into visual tasks to improve downstream performance. In this preliminary study, we proposed a novel text-guided DDPM for PET image denoising that integrated anatomical priors through text prompts. Anatomical text descriptions were encoded using a pre-trained CLIP text encoder to extract semantic guidance, which was then incorporated into the diffusion process via the cross-attention mechanism. Evaluations based on paired 1/20 low-dose and normal-dose 18F-FDG PET datasets demonstrated that the proposed method achieved better quantitative performance than conventional UNet and standard DDPM methods at both the whole-body and organ levels. These results underscored the potential of leveraging VLMs to integrate rich metadata into the diffusion framework to enhance the image quality of low-dose PET scans.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。