arXiv:2511.15188cs.CVcs.LG2025-11

混合视觉变压器与残差网络,提升脑龄预测精度与可解释性

BrainRotViT: Transformer-ResNet Hybrid for Explainable Modeling of Brain Aging from 3D sMRI

  • 用预训练ViT提取切片特征,再用残差CNN回归预测脑龄
  • 跨11个数据集平均误差仅3.34年,对自闭症等疾病敏感
  • 注意力图揭示小脑蚓部等老化关键区域,适合神经退行性研究

从结构磁共振成像(sMRI)准确估计脑龄是研究衰老和神经退行性病变的重要生物标志物。传统回归与基于卷积神经网络(CNN)的方法存在手工特征工程、感受野有限及在异质数据上过拟合等问题。纯视觉变压器(ViT)模型虽有效,但需大量数据且计算成本高。本文提出BrainResNet over trained Vision Transformer(BrainRotViT),融合了视觉变压器的全局建模能力与残差网络的局部优化能力。首先在辅助的年龄与性别分类任务上训练ViT编码器,以学习切片级特征;随后将冻结的编码器应用于所有矢状切片,生成2D嵌入矩阵,并输入残差CNN回归器,最终全连接层融合个体性别信息以预测连续脑龄。该方法在涵盖130多个采集站点的11个独立MRI数据集上验证,平均绝对误差(MAE)为3.34年(皮尔逊相关系数$r=0.98$,斯皮尔曼等级相关系数$ρ=0.97$,决定系数$R^2=0.95$),优于基线与现有先进模型。在4个独立队列中,其MAE介于3.77至5.04年之间,表现出强泛化能力。脑龄差分析显示,老化模式与阿尔茨海默病、认知障碍及自闭症谱系障碍显著相关。模型注意力图揭示了小脑蚓部、中央前回与后回、颞叶及内侧上额叶等关键老化区域。结果表明,该方法提供了一种高效、可解释且泛化性强的脑龄预测框架,弥合了CNN与变压器方法之间的差距,为衰老与神经退行性研究开辟新路径。

原文摘要 · Abstract (English)

Accurate brain age estimation from structural MRI is a valuable biomarker for studying aging and neurodegeneration. Traditional regression and CNN-based methods face limitations such as manual feature engineering, limited receptive fields, and overfitting on heterogeneous data. Pure transformer models, while effective, require large datasets and high computational cost. We propose Brain ResNet over trained Vision Transformer (BrainRotViT), a hybrid architecture that combines the global context modeling of vision transformers (ViT) with the local refinement of residual CNNs. A ViT encoder is first trained on an auxiliary age and sex classification task to learn slice-level features. The frozen encoder is then applied to all sagittal slices to generate a 2D matrix of embedding vectors, which is fed into a residual CNN regressor that incorporates subject sex at the final fully-connected layer to estimate continuous brain age. Our method achieves an MAE of 3.34 years (Pearson $r=0.98$, Spearman $ρ=0.97$, $R^2=0.95$) on validation across 11 MRI datasets encompassing more than 130 acquisition sites, outperforming baseline and state-of-the-art models. It also generalizes well across 4 independent cohorts with MAEs between 3.77 and 5.04 years. Analyses on the brain age gap (the difference between the predicted age and actual age) show that aging patterns are associated with Alzheimer's disease, cognitive impairment, and autism spectrum disorder. Model attention maps highlight aging-associated regions of the brain, notably the cerebellar vermis, precentral and postcentral gyri, temporal lobes, and medial superior frontal gyrus. Our results demonstrate that this method provides an efficient, interpretable, and generalizable framework for brain-age prediction, bridging the gap between CNN- and transformer-based approaches while opening new avenues for aging and neurodegeneration research.

脑龄预测可解释性混合模型神经退行性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。