用分层专家模型统一生成脑连接图并预测疾病与认知指标
BrainCSD: A Hierarchical Consistency-Driven MoE Foundation Model for Unified Connectome Synthesis and Multitask Brain Trait Prediction
- 分层混合专家架构,融合脑区、时间动态和网络结构先验
- 无功能连接时也能准确分类轻度痴呆,合成误差极低
- 适合脑科学、医学影像分析与多模态建模研究者
功能连接(FC)和结构连接(SC)是脑科学分析的关键多模态生物标志物,但其临床应用受限于高昂的采集成本、复杂的预处理流程以及频繁缺失模态。现有基础模型或仅处理单一模态,或缺乏显式的跨模态与跨尺度一致性机制。本文提出BrainCSD,一种分层混合专家(MoE)基础模型,可联合生成FC/SC生物标志物,并支持下游解码任务(如诊断与预测)。模型包含三个神经解剖学引导组件:(1) 区域特异性MoE,通过对比一致性将经典网络(如默认模式网络DMN、额顶网络FPN)的区域激活与全局图谱对齐;(2) 编码-激活MoE,建模fMRI/dMRI中的动态跨时间/梯度依赖关系;(3) 网络感知精修MoE,于个体与群体层面施加结构先验与对称性约束。在完整与缺失模态设置下评估,结果表明:无需FC即可实现MCI vs. CN分类95.6%准确率,合成误差低(FC RMSE: 0.038;SC RMSE: 0.006),脑龄预测平均绝对误差4.04年,MMSE评分估计误差1.72分。代码已开源。
原文摘要 · Abstract (English)
Functional and structural connectivity (FC/SC) are key multimodal biomarkers for brain analysis, yet their clinical utility is hindered by costly acquisition, complex preprocessing, and frequent missing modalities. Existing foundation models either process single modalities or lack explicit mechanisms for cross-modal and cross-scale consistency. We propose BrainCSD, a hierarchical mixture-of-experts (MoE) foundation model that jointly synthesizes FC/SC biomarkers and supports downstream decoding tasks (diagnosis and prediction). BrainCSD features three neuroanatomically grounded components: (1) a ROI-specific MoE that aligns regional activations from canonical networks (e.g., DMN, FPN) with a global atlas via contrastive consistency; (2) a Encoding-Activation MOE that models dynamic cross-time/gradient dependencies in fMRI/dMRI; and (3) a network-aware refinement MoE that enforces structural priors and symmetry at individual and population levels. Evaluated on the datasets under complete and missing-modality settings, BrainCSD achieves SOTA results: 95.6\% accuracy for MCI vs. CN classification without FC, low synthesis error (FC RMSE: 0.038; SC RMSE: 0.006), brain age prediction (MAE: 4.04 years), and MMSE score estimation (MAE: 1.72 points). Code is available in \href{https://github.com/SXR3015/BrainCSD}{BrainCSD}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。