用Transformer模型从新生儿脑影像预测早期发育水平
Swin fMRI Transformer Predicts Early Neurodevelopmental Outcomes from Neonatal fMRI
- 基于Swin架构的4D fMRI Transformer,端到端处理时空脑影像
- 在dHCP数据上显著优于基线模型,多任务预测表现更优
- 可解释性分析揭示与早期认知发展相关的神经区域
人类生命最初几个月是大脑快速结构生长与功能组织的关键阶段。准确预测此时期发育结果对识别发育迟缓和及时干预至关重要。本研究提出Swin fMRI Transformer(SwiFT)模型,利用来自发育中人脑连接组计划(dHCP)的新生儿功能磁共振成像(fMRI)数据,预测贝利婴儿发育量表第三版(Bayley-III)综合评分。为提升预测精度,采用组独立成分分析(group ICA)进行降维,并在大规模成人fMRI数据集上预训练,以缓解新生儿数据有限的问题。结果显示,SwiFT在认知、运动和语言三类发育结果的单标签与多标签预测任务中均显著优于基线模型。其基于注意力机制的架构能有效处理时空脑数据,实现优越预测性能。此外,通过集成梯度与平滑梯度平方(IG-SQ)方法进行可解释性分析,识别出与早期认知和行为发育相关的关键神经空间表征。这些发现表明,Transformer模型在神经发育研究与临床应用中具有巨大潜力。
原文摘要 · Abstract (English)
Brain development in the first few months of human life is a critical phase characterized by rapid structural growth and functional organization. Accurately predicting developmental outcomes during this time is crucial for identifying delays and enabling timely interventions. This study introduces the SwiFT (Swin 4D fMRI Transformer) model, designed to predict Bayley-III composite scores using neonatal fMRI from the Developing Human Connectome Project (dHCP). To enhance predictive accuracy, we apply dimensionality reduction via group independent component analysis (ICA) and pretrain SwiFT on large adult fMRI datasets to address the challenges of limited neonatal data. Our analysis shows that SwiFT significantly outperforms baseline models in predicting cognitive, motor, and language outcomes, leveraging both single-label and multi-label prediction strategies. The model's attention-based architecture processes spatiotemporal data end-to-end, delivering superior predictive performance. Additionally, we use Integrated Gradients with Smoothgrad sQuare (IG-SQ) to interpret predictions, identifying neural spatial representations linked to early cognitive and behavioral development. These findings underscore the potential of Transformer models to advance neurodevelopmental research and clinical practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。