用结构核磁生成缺失的阿尔茨海默病正电子发射断层图像
Cross-modal Medical Image Generation Based on Pyramid Convolutional Attention Network
- 基于金字塔卷积与通道注意力,融合多尺度局部特征和全局关联信息
- 生成图像平均绝对误差0.0194,结构相似性达0.9486,接近真实图像
- 生成结果可有效辅助诊断,分类准确率达94.21%,适合医学影像补全场景
多模态医学影像融合可为阿尔茨海默病(AD)诊断提供互补且全面的信息。然而临床上常因正电子发射断层扫描(PET)缺失导致多模态图像不完整。为此,本文提出一种高效利用结构磁共振成像(sMRI)生成高质量PET图像的方法。模型结合金字塔卷积与通道注意力机制,提取sMRI的多尺度局部特征,并通过自注意力注入全局相关性信息,确保生成的PET图像在局部纹理与全局结构上均具高保真度。此外,引入额外损失函数以指导生成过程。在公开的ADNI数据集上的实验表明,生成图像在多项指标上优于已有方法(平均绝对误差:0.0194,峰值信噪比:29.65,结构相似性:0.9486),接近真实图像。将生成的PET与对应sMRI联合用于AD诊断任务,分类准确率达94.21%,超越同类方法。实验验证了本方法在定量指标、可视化效果与评估标准上均优于现有竞争方法。
原文摘要 · Abstract (English)
The integration of multimodal medical imaging can provide complementary and comprehensive information for the diagnosis of Alzheimer's disease (AD). However, in clinical practice, since positron emission tomography (PET) is often missing, multimodal images might be incomplete. To address this problem, we propose a method that can efficiently utilize structural magnetic resonance imaging (sMRI) image information to generate high-quality PET images. Our generation model efficiently utilizes pyramid convolution combined with channel attention mechanism to extract multi-scale local features in sMRI, and injects global correlation information into these features using self-attention mechanism to ensure the restoration of the generated PET image on local texture and global structure. Additionally, we introduce additional loss functions to guide the generation model in producing higher-quality PET images. Through experiments conducted on publicly available ADNI databases, the generated images outperform previous research methods in various performance indicators (average absolute error: 0.0194, peak signal-to-noise ratio: 29.65, structural similarity: 0.9486) and are close to real images. In promoting AD diagnosis, the generated images combined with their corresponding sMRI also showed excellent performance in AD diagnosis tasks (classification accuracy: 94.21 %), and outperformed previous research methods of the same type. The experimental results demonstrate that our method outperforms other competing methods in quantitative metrics, qualitative visualization, and evaluation criteria.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。