对比三种模型发现,卷积网络最擅长从脑影像中区分性别。
Deep Learning Inductive Biases for fMRI Time Series Classification during Resting-state and Movie-watching
- 用卷积、LSTM、Transformer模型比较脑活动模式识别效果
- 卷积网络在静息态和观影时均表现最优,准确率最高
- 局部空间模式比序列依赖更关键,适合小样本数据
深度学习已推动功能磁共振成像分析发展,但何种架构的归纳偏置最有效仍不明确,尤其在小样本场景下。本文对比了卷积神经网络(CNN)、长短期记忆网络(LSTM)和Transformer在人类连接组计划(HCP)7特斯拉队列中的生物性别分类任务表现,该数据包含四个静息态运行和四个观影任务运行的分块多变量fMRI时间序列。模型在全脑、皮层下区及12个功能网络上进行评估。结果显示,CNN在静息态和观影任务中均取得最佳分类性能,而LSTM与Transformer表现较差。网络解析分析表明,全脑、默认模式网络、扣带-外侧网络、背侧注意网络和额顶网络最具判别性。这些结果在静息态与观影条件下高度一致。研究指出,在当前数据规模下,判别信息主要由局部空间模式和区域间依赖关系携带,偏好卷积归纳偏置。本研究为选择fMRI时间序列分类的深度学习架构提供了实证依据。
原文摘要 · Abstract (English)
Deep learning has advanced fMRI analysis, yet it remains unclear which architectural inductive biases are most effective at capturing functional patterns in human brain activity. This issue is particularly important in small-sample settings, as most datasets fall into this category. We compare models with three major inductive biases in deep learning including convolutional neural networks (CNNs), long short-term memory networks (LSTMs), and Transformers for the task of biological sex classification. These models are evaluated within a unified pipeline using parcellated multivariate fMRI time series from the Human Connectome Project (HCP) 7-Tesla cohort, which includes four resting-state runs and four movie-watching task runs. We assess performance on Whole-brain, subcortex, and 12 functional networks. CNNs consistently achieved the highest discrimination for sex classification in both resting-state and movie-watching, while LSTM and Transformer models underperformed. Network-resolved analyses indicated that the Whole-brain, Default Mode, Cingulo-Opercular, Dorsal Attention, and Frontoparietal networks were the most discriminative. These results were largely similar between resting-state and movie-watching. Our findings indicate that, at this dataset size, discriminative information is carried by local spatial patterns and inter-regional dependencies, favoring convolutional inductive bias. Our study provides insights for selecting deep learning architectures for fMRI time series classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。