通过脑-环境交互构建大模型,提升脑影像临床应用性能
Large Connectome Model: An fMRI Foundation Model of Brain Connectomes Empowered by Brain-Environment Interaction in Multitask Learning Landscape
- 将脑影像与环境、人口统计信息联合建模,实现多任务预训练
- 在自闭症等五类疾病中实现早期诊断,表现优于现有方法
- 适合神经影像临床研究者和医疗AI开发者参考
可靠的脑功能影像基础模型对推动临床应用至关重要,当前AI模型因样本量有限而性能受限。为此,研究者利用大量未标注的fMRI数据,通过可扩展的自监督学习进行大规模模型预训练。然而,自监督信号未必与脑-结果关联一致,导致多数基础模型在下游任务(如疾病预后预测)中表现不佳。本文通过融合丰富的环境变量与人口统计学数据,将脑建模置于多任务学习框架下,提出一种可扩展架构:(i) 通过分词化多个脑-环境交互(BEI)实现多任务预训练;(ii) 通过为预训练的BEI分配伪标签,实现半监督微调。我们在多种应用场景中评估该模型,包括性别预测、人类行为识别及自闭症、帕金森病、阿尔茨海默病和精神分裂症的早期诊断,结果表明其具有显著潜力,可助力神经影像在临床实践中的落地。
原文摘要 · Abstract (English)
A reliable foundation model of functional neuroimages is critical to promote clinical applications where the performance of current AI models is significantly impeded by a limited sample size. To that end, tremendous efforts have been made to pretraining large models on extensive unlabeled fMRI data using scalable self-supervised learning. Since self-supervision is not necessarily aligned with the brain-to-outcome relationship, most foundation models are suboptimal to the downstream task, such as predicting disease outcomes. By capitalizing on rich environmental variables and demographic data along with an unprecedented amount of functional neuroimages, we form the brain modeling as a multitask learning and present a scalable model architecture for (i) multitask pretraining by tokenizing multiple brain-environment interactions (BEI) and (ii) semi-supervised finetuning by assigning pseudo-labels of pretrained BEI. We have evaluated our foundation model on a variety of applications, including sex prediction, human behavior recognition, and disease early diagnosis of Autism, Parkinson's disease, Alzheimer's disease, and {Schizophrenia}, where promising results indicate the great potential to facilitate current neuroimaging applications in clinical routines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。