arXiv:2507.21016cs.LGq-bio.NC2025-07被引 2

对比多种模型,发现结合结构与功能连接的图网络在认知预测中表现最佳。

Predicting Cognition from fMRI:A Comparative Study of Graph, Transformer, and Kernel Models Across Task and Rest Conditions

  • 用图神经网络融合结构和功能连接,提升认知预测性能
  • 任务态fMRI比静息态更利于预测认知行为,效果显著优于静息态
  • 基于Transformer的模型适合捕捉动态变化,但对静息态数据表现不佳

从健康个体的脑影像数据预测认知能力,有助于理解认知的神经机制,并在精准医疗及神经精神疾病早期检测中具有应用潜力。本研究系统比较了经典机器学习(核岭回归,KRR)与先进深度学习模型(图神经网络,GNN;Transformer-图神经网络,TGNN),使用人类连接组计划青年成人数据集中的静息态(RS)、工作记忆与语言任务态fMRI数据进行认知预测。基于R²、皮尔逊相关系数与平均绝对误差的结果显示,任务态fMRI因其直接反映认知相关神经活动,预测性能显著优于静息态fMRI。在所有方法中,结合结构连接(SC)与功能连接(FC)的GNN在各类fMRI模态下均表现最优;然而其相比仅使用FC的KRR并无统计学显著优势。设计用于建模时间动态的TGNN在任务态fMRI上表现良好,但在静息态数据上表现较差,与直接以fMRI时序数据为节点特征的低效GNN相当。结果强调了选择合适模型架构与特征表示的重要性,以充分挖掘脑影像的空间与时间信息。该研究展示了多模态图感知深度学习模型融合SC与FC的潜力,以及Transformer方法在捕捉时间动态方面的前景,为利用fMRI、SC与深度学习推进脑-行为建模提供了全面参考。

原文摘要 · Abstract (English)

Predicting cognition from neuroimaging data in healthy individuals offers insights into the neural mechanisms underlying cognitive abilities, with potential applications in precision medicine and early detection of neurological and psychiatric conditions. This study systematically benchmarked classical machine learning (Kernel Ridge Regression (KRR)) and advanced deep learning (DL) models (Graph Neural Networks (GNN) and Transformer-GNN (TGNN)) for cognitive prediction using Resting-state (RS), Working Memory, and Language task fMRI data from the Human Connectome Project Young Adult dataset. Our results, based on R2 scores, Pearson correlation coefficient, and mean absolute error, revealed that task-based fMRI, eliciting neural responses directly tied to cognition, outperformed RS fMRI in predicting cognitive behavior. Among the methods compared, a GNN combining structural connectivity (SC) and functional connectivity (FC) consistently achieved the highest performance across all fMRI modalities; however, its advantage over KRR using FC alone was not statistically significant. The TGNN, designed to model temporal dynamics with SC as a prior, performed competitively with FC-based approaches for task-fMRI but struggled with RS data, where its performance aligned with the lower-performing GNN that directly used fMRI time-series data as node features. These findings emphasize the importance of selecting appropriate model architectures and feature representations to fully leverage the spatial and temporal richness of neuroimaging data. This study highlights the potential of multimodal graph-aware DL models to combine SC and FC for cognitive prediction, as well as the promise of Transformer-based approaches for capturing temporal dynamics. By providing a comprehensive comparison of models, this work serves as a guide for advancing brain-behavior modeling using fMRI, SC and DL.

fMRI图神经网络认知预测深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。