用模块化框架提升脑影像分析效率与精度,精准预测年龄与认知能力。
Bridging Foundation Models and Efficient Architectures: A Modular Brain Imaging Framework with Local Masking and Pretrained Representation Learning
- 分步设计:先局部掩码自编码预训练,再随机游走专家聚类,最后状态空间模型推理。
- 在Cam-CAN数据集上,年龄预测MAE仅5.343,流体智力预测PCC达0.887,超越现有方法。
- 可解释性强,能定位关键脑区,适合神经科学与临床计算研究者使用。
基于静息态功能磁共振成像(fMRI)的功能连接(FC)对个性化预测(如年龄、认知表现)至关重要。然而,将基础模型(FM)应用于高维、计算复杂且难以捕捉时空动态及间接区域交互的fMRI数据仍具挑战。为此,我们提出一种模块化神经影像框架,融合基础模型理念与高效领域专用架构。首先通过局部掩码自编码器(LMAE)进行预训练,降低血流动力学响应函数(HRF)影响并抑制噪声;随后采用随机游走混合专家(RWMOE)模块,在时空维度聚类特征,有效捕捉复杂脑区互动;最后由状态空间模型(SSM)完成下游任务推断。在剑桥衰老与神经科学中心(Cam-CAN)数据集上,该框架在年龄预测中取得5.343的均方绝对误差(MAE),流体智力预测的皮尔逊相关系数(PCC)为0.887,均优于现有最先进方法。专家分布权重可视化进一步提升了可解释性,识别出关键脑区。本工作为fMRI分析提供了一种鲁棒、可解释的替代方案,揭示了脑老化与认知功能的新机制。
原文摘要 · Abstract (English)
Functional connectivity (FC) derived from resting-state fMRI plays a critical role in personalized predictions such as age and cognitive performance. However, applying foundation models(FM) to fMRI data remains challenging due to its high dimensionality, computational complexity, and the difficulty in capturing complex spatiotemporal dynamics and indirect region-of-interest (ROI) interactions. To address these limitations, we propose a modular neuroimaging framework that integrates principles from FM with efficient, domain-specific architectures. Our approach begins with a Local Masked Autoencoder (LMAE) for pretraining, which reduces the influence of hemodynamic response function (HRF) dynamics and suppresses noise. This is followed by a Random Walk Mixture of Experts (RWMOE) module that clusters features across spatial and temporal dimensions, effectively capturing intricate brain interactions. Finally, a state-space model (SSM)-based predictor performs downstream task inference. Evaluated on the Cambridge Centre for Ageing and Neuroscience (Cam-CAN) dataset, our framework achieved mean absolute errors (MAEs) of 5.343 for age prediction and 2.940 for fluid intelligence, with Pearson correlation coefficients (PCCs) of 0.928 and 0.887, respectively-outperforming existing state-of-the-art methods. Visualization of expert distribution weights further enhances interpretability by identifying key brain regions. This work provides a robust, interpretable alternative to LLM-based approaches for fMRI analysis, offering novel insights into brain aging and cognitive function.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。