用图模型统一建模脑区连接,跨多种脑图谱和疾病预训练。
A Brain Graph Foundation Model: Pre-Training and Prompt-Tuning across Broad Atlases and Disorders
- 基于图对比学习与掩码自编码器,构建脑图谱预训练框架。
- 在27个数据集、超2.5万患者中训练,覆盖8种图谱划分方式。
- 支持少样本/零样本适配新疾病,适合脑科学与临床研究者使用。
随着大语言模型推动AI发展,构建大规模脑基础模型成为神经科学新方向。现有模型多基于时间序列或连接组特征,本文提出一种新型图结构预训练范式,构建脑图基础模型BrainGFM。该模型采用图对比学习与图掩码自编码器,在包含25种常见神经与精神疾病的27个神经影像数据集上进行大规模预训练,涵盖2类脑图谱(功能与解剖)及8种常用分割方案,覆盖超过25,000名受试者、60,000次fMRI扫描,共生成400,000个图样本。为支持高效下游迁移,模型融合图提示与语言提示机制,结合元学习优化图提示,实现对未见疾病的少样本与零样本泛化,适用于多种脑图谱、疾病类型与任务场景。
原文摘要 · Abstract (English)
As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on time-series signals or connectome features, we propose a novel graph-based pre-training paradigm for constructing a brain graph foundation model. In this paper, we introduce the Brain Graph Foundation Model, termed BrainGFM, a unified framework that leverages graph contrastive learning and graph masked autoencoders for large-scale fMRI-based pre-training. BrainGFM is pre-trained on a diverse mixture of brain atlases with varying parcellations, significantly expanding the pre-training corpus and enhancing the model's ability to generalize across heterogeneous fMRI-derived brain representations. To support efficient and versatile downstream transfer, we integrate both graph prompts and language prompts into the model design, enabling BrainGFM to flexibly adapt to a wide range of atlases, neurological and psychiatric disorders, and task settings. Furthermore, we employ meta-learning to optimize the graph prompts, facilitating strong generalization to previously unseen disorders under both few-shot and zero-shot learning conditions via language-guided prompting. BrainGFM is pre-trained on 27 neuroimaging datasets spanning 25 common neurological and psychiatric disorders, encompassing 2 types of brain atlases (functional and anatomical) across 8 widely-used parcellations, and covering over 25,000 subjects, 60,000 fMRI scans, and a total of 400,000 graph samples aggregated across all atlases and parcellations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。