arXiv:2411.08424cs.CVcs.AI2024-11被引 3

用异构图神经网络融合功能与结构脑连接,提升轻度认知障碍诊断准确率。

A Heterogeneous Graph Neural Network Fusing Functional and Structural Connectivity for MCI Diagnosis

  • 构建异构图模型,分别捕捉同模态内部和跨模态间的脑连接关系。
  • 在ADNI-3数据集上实现93.3%的平均分类准确率,优于现有方法。
  • 适合脑疾病诊断、医学影像分析领域的研究人员参考。

与脑疾病相关的脑连接变化已在静息态功能磁共振(rs-fMRI)和弥散张量成像(DTI)中广泛报道。尽管已有多种基于图神经网络(GNNs)的双模态融合方法,但大多采用同质融合方式,忽略了双模态信息的丰富异质性。为此,本文提出一种基于异构图神经网络(HGNNs)的新方法,通过整合功能与结构连接信息,更有效地利用双模态图像中的异质性。首先,利用血氧水平依赖信号和白质结构信息,建立同模态元路径(homo-meta-path),捕捉同一模态内节点间的关系;同时,提出基于结构-功能耦合与脑社区搜索的异构元路径(hetero-meta-path),以建模跨模态节点间的关系。其次,引入异构图池化策略,自动平衡同异构元路径的信息权重,有效避免池化后特征混淆。第三,基于异构图的灵活性,提出一种异构图数据增强方法,可便捷解决临床诊断中常见的样本不平衡问题。在ADNI-3数据集上评估轻度认知障碍(MCI)诊断性能,实验结果表明该方法有效且优于其他算法,平均分类准确率达93.3%。

原文摘要 · Abstract (English)

Brain connectivity alternations associated with brain disorders have been widely reported in resting-state functional imaging (rs-fMRI) and diffusion tensor imaging (DTI). While many dual-modal fusion methods based on graph neural networks (GNNs) have been proposed, they generally follow homogenous fusion ways ignoring rich heterogeneity of dual-modal information. To address this issue, we propose a novel method that integrates functional and structural connectivity based on heterogeneous graph neural networks (HGNNs) to better leverage the rich heterogeneity in dual-modal images. We firstly use blood oxygen level dependency and whiter matter structure information provided by rs-fMRI and DTI to establish homo-meta-path, capturing node relationships within the same modality. At the same time, we propose to establish hetero-meta-path based on structure-function coupling and brain community searching to capture relations among cross-modal nodes. Secondly, we further introduce a heterogeneous graph pooling strategy that automatically balances homo- and hetero-meta-path, effectively leveraging heterogeneous information and preventing feature confusion after pooling. Thirdly, based on the flexibility of heterogeneous graphs, we propose a heterogeneous graph data augmentation approach that can conveniently address the sample imbalance issue commonly seen in clinical diagnosis. We evaluate our method on ADNI-3 dataset for mild cognitive impairment (MCI) diagnosis. Experimental results indicate the proposed method is effective and superior to other algorithms, with a mean classification accuracy of 93.3%.

脑连接异构图MCI诊断双模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。