用跨模态注意力融合多组学数据,提升阿尔茨海默病诊断准确率
Multi-omic Prognosis of Alzheimer's Disease with Asymmetric Cross-Modal Cross-Attention Network
- 设计不对称跨模态注意力机制,精准捕捉不同数据间的交互特征
- 在测试集上达到94.88%的诊断准确率,优于传统方法
- 适合从事神经退行性疾病智能诊断的研究者与临床医生
阿尔茨海默病(AD)是一种不可逆的神经退行性疾病,以认知功能进行性下降为主要症状。在深度学习辅助诊断领域,传统卷积神经网络和简单的特征拼接方法难以有效利用多模态数据间的互补信息,且特征拼接易导致关键信息丢失。近年来,深度学习技术的发展为解决多模态特征融合问题带来新可能。本文提出一种新型深度学习算法框架,通过融合脑部氟代脱氧葡萄糖正电子发射断层扫描(PET)、磁共振成像(MRI)、遗传数据及临床数据等多视图医学信息,实现对阿尔茨海默病(AD)、轻度认知障碍(MCI)和认知正常(CN)的精准判别。算法核心创新在于采用不对称跨模态交叉注意力机制,有效捕获不同数据模态间的关键特征交互。本文将该机制与单模态及传统多模态深度学习模型进行对比,验证其在AD诊断中的有效性。实验结果表明,该模型在测试集上达到94.88%的准确率。
原文摘要 · Abstract (English)
Alzheimer's Disease (AD) is an irreversible neurodegenerative disease characterized by progressive cognitive decline as its main symptom. In the research field of deep learning-assisted diagnosis of AD, traditional convolutional neural networks and simple feature concatenation methods fail to effectively utilize the complementary information between multimodal data, and the simple feature concatenation approach is prone to cause the loss of key information during the process of modal fusion. In recent years, the development of deep learning technology has brought new possibilities for solving the problem of how to effectively fuse multimodal features. This paper proposes a novel deep learning algorithm framework to assist medical professionals in AD diagnosis. By fusing medical multi-view information such as brain fluorodeoxyglucose positron emission tomography (PET), magnetic resonance imaging (MRI), genetic data, and clinical data, it can accurately detect the presence of AD, Mild Cognitive Impairment (MCI), and Cognitively Normal (CN). The innovation of the algorithm lies in the use of an asymmetric cross-modal cross-attention mechanism, which can effectively capture the key information features of the interactions between different data modal features. This paper compares the asymmetric cross-modal cross-attention mechanism with the traditional algorithm frameworks of unimodal and multimodal deep learning models for AD diagnosis, and evaluates the importance of the asymmetric cross-modal cross-attention mechanism. The algorithm model achieves an accuracy of 94.88% on the test set.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。