arXiv:2412.06212cs.LGcs.AI2024-12被引 2

用自然语言自动注入医学知识,提升阿尔茨海默病图神经网络的诊断能力。

A Self-guided Multimodal Approach to Enhancing Graph Representation Learning for Alzheimer's Diseases

  • 将医学文献转为自然语言,让模型自主学习领域知识。
  • 在真实数据上实现更高诊断准确率与可解释性。
  • 适合医疗AI研究者和需要可解释模型的临床应用。

图神经网络(GNN)擅长处理非规则结构数据,但在分析阿尔茨海默病(AD)脑连接组时表现受限,需融入领域知识以提升性能。现有方法依赖计算机科学家与领域专家协作,耗时且资源密集。本文提出一种自引导、多模态融合的GNN框架,将领域知识视为自然语言,通过多模态机制自动提取并注入模型训练过程。我们构建了包含近期同行评审论文的综合性知识库,并与多个真实世界AD数据集结合。实验表明,该方法能有效提取相关知识,提供基于图的诊断解释,并提升整体性能。相比人工设计,该方法更具可扩展性和效率,显著提升了AD诊断的准确性与可解释性。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) are powerful machine learning models designed to handle irregularly structured data. However, their generic design often proves inadequate for analyzing brain connectomes in Alzheimer's Disease (AD), highlighting the need to incorporate domain knowledge for optimal performance. Infusing AD-related knowledge into GNNs is a complicated task. Existing methods typically rely on collaboration between computer scientists and domain experts, which can be both time-intensive and resource-demanding. To address these limitations, this paper presents a novel self-guided, knowledge-infused multimodal GNN that autonomously incorporates domain knowledge into the model development process. Our approach conceptualizes domain knowledge as natural language and introduces a specialized multimodal GNN capable of leveraging this uncurated knowledge to guide the learning process of the GNN, such that it can improve the model performance and strengthen the interpretability of the predictions. To evaluate our framework, we curated a comprehensive dataset of recent peer-reviewed papers on AD and integrated it with multiple real-world AD datasets. Experimental results demonstrate the ability of our method to extract relevant domain knowledge, provide graph-based explanations for AD diagnosis, and improve the overall performance of the GNN. This approach provides a more scalable and efficient alternative to inject domain knowledge for AD compared with the manual design from the domain expert, advancing both prediction accuracy and interpretability in AD diagnosis.

图神经网络阿尔茨海默病多模态可解释AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。