arXiv:2512.06303cs.LG2025-12

融合多模态脑影像,用图神经网络预测认知衰退风险。

Multimodal Graph Neural Networks for Prognostic Modeling of Brain Network Reorganization

  • 构建时序脑图模型,整合结构、功能与弥散影像数据。
  • 捕捉长期依赖与随机波动,预测个体认知衰退风险。
  • 生成可解释生物标志物,适合临床研究与个性化医疗。

理解脑网络动态重组对预测认知衰退、神经退行性进展及个体临床结局差异至关重要。本文提出一种多模态图神经网络框架,融合结构磁共振(sMRI)、弥散张量成像(DTI)和功能磁共振(fMRI),构建纵向脑图模型。以脑区为节点,结构与功能连接为边,通过嵌入图递归网络的分数阶随机微分算子捕捉时间演化,建模长期依赖与随机波动。注意力机制融合多模态信息,生成可解释生物标志物,包括网络能量熵、图曲率、分数阶记忆指数及模态特异性注意力得分。这些指标组合成综合预后指数,量化个体脑网络不稳定性或认知衰退风险。在纵向神经影像数据集上的实验验证了模型的预测准确性和可解释性。结果表明,基于数学严谨的多模态图方法,可从现有影像数据中挖掘临床有意义的生物标志物,无需额外数据采集。

原文摘要 · Abstract (English)

Understanding the dynamic reorganization of brain networks is critical for predicting cognitive decline, neurological progression, and individual variability in clinical outcomes. This work proposes a multimodal graph neural network framework that integrates structural MRI, diffusion tensor imaging, and functional MRI to model spatiotemporal brain network reorganization. Brain regions are represented as nodes and structural and functional connectivity as edges, forming longitudinal brain graphs for each subject. Temporal evolution is captured via fractional stochastic differential operators embedded within graph-based recurrent networks, enabling the modeling of long-term dependencies and stochastic fluctuations in network dynamics. Attention mechanisms fuse multimodal information and generate interpretable biomarkers, including network energy entropy, graph curvature, fractional memory indices, and modality-specific attention scores. These biomarkers are combined into a composite prognostic index to quantify individual risk of network instability or cognitive decline. Experiments on longitudinal neuroimaging datasets demonstrate both predictive accuracy and interpretability. The results highlight the potential of mathematically rigorous, multimodal graph-based approaches for deriving clinically meaningful biomarkers from existing imaging data without requiring new data collection.

脑网络图神经网络多模态融合预后预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。