arXiv:2503.00586eess.IVcs.CV2025-03被引 1

用交叉注意力融合核磁与形变图,提升阿尔茨海默病早期诊断准确率。

Cross-Attention Fusion of MRI and Jacobian Maps for Alzheimer's Disease Diagnosis

  • 通过交叉注意力建模核磁强度与脑部形变间的关联。
  • 在ADNI数据集上达0.903的平均AUC(AD vs CN)。
  • 参数量仅156万,远低于主流模型,适合临床部署。

阿尔茨海默病(AD)的早期诊断对干预至关重要。结构化核磁共振(sMRI)广泛用于诊断,但传统深度学习方法主要依赖强度特征,需大量数据捕捉细微结构变化。雅可比行列式图(JSM)通过编码局部脑部形变提供互补信息,现有多模态融合策略未能充分整合。本文提出一种交叉注意力融合框架,建模sMRI强度与JSM形变之间的内在关系,用于AD分类。基于阿尔茨海默病神经影像计划(ADNI)数据集,对比交叉注意力、成对自注意力和瓶颈注意力,结合四种预训练3D图像编码器。交叉注意力融合表现最优,对AD vs 认知正常(CN)的平均ROC-AUC达0.903(±0.033),对轻度认知障碍(MCI) vs CN为0.692(±0.061)。模型参数仅156万,远少于ResNet-34(6300万)和Swin UNETR(6198万),兼具高精度与高效性,证明交叉注意力融合在提升诊断能力的同时保持计算效率。

原文摘要 · Abstract (English)

Early diagnosis of Alzheimer's disease (AD) is critical for intervention before irreversible neurodegeneration occurs. Structural MRI (sMRI) is widely used for AD diagnosis, but conventional deep learning approaches primarily rely on intensity-based features, which require large datasets to capture subtle structural changes. Jacobian determinant maps (JSM) provide complementary information by encoding localized brain deformations, yet existing multimodal fusion strategies fail to fully integrate these features with sMRI. We propose a cross-attention fusion framework to model the intrinsic relationship between sMRI intensity and JSM-derived deformations for AD classification. Using the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, we compare cross-attention, pairwise self-attention, and bottleneck attention with four pre-trained 3D image encoders. Cross-attention fusion achieves superior performance, with mean ROC-AUC scores of 0.903 (+/-0.033) for AD vs. cognitively normal (CN) and 0.692 (+/-0.061) for mild cognitive impairment (MCI) vs. CN. Despite its strong performance, our model remains highly efficient, with only 1.56 million parameters--over 40 times fewer than ResNet-34 (63M) and Swin UNETR (61.98M). These findings demonstrate the potential of cross-attention fusion for improving AD diagnosis while maintaining computational efficiency.

阿尔茨海默病多模态融合交叉注意力医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。