arXiv:2409.00003eess.SPcs.LG2024-09被引 2

用深度模型分析脑影像,发现视觉区主导认知状态区分。

Cognitive Networks and Performance Drive fMRI-Based State Classification Using DNN Models

  • 用1D-CNN和BiLSTM两类模型从fMRI数据分类认知状态。
  • 模型预测准确率与个体认知表现强相关,低表现者预测差。
  • 可视化网络最重要,注意控制网络次之,默认模式网络作用小。

深度神经网络在多个领域表现优异,但在认知神经科学中的应用受限于其可解释性不足。本研究采用两种结构不同的互补模型——一维卷积神经网络(1D-CNN)和双向长短期记忆网络(BiLSTM),从fMRI BOLD信号中分类个体认知状态,并关注分类决策的认知基础。尽管架构不同,两类模型均显示出预测准确率与个体认知表现之间的一致性关系:表现差导致预测准确率下降。为实现模型可解释性,采用置换法计算特征重要性,识别出影响预测的关键脑区。跨模型分析发现,视觉网络占据主导地位,表明任务驱动的状态差异主要编码于视觉处理过程;注意与控制网络也具较高重要性,而默认模式网络和颞顶网络对状态区分贡献微弱。此外,观察到个体特质效应及模型特异性差异:1D-CNN整体性能略优,而BiLSTM对个体行为的敏感性更高。这些初步发现需进一步研究与稳健性验证。本工作强调可解释深度学习模型在揭示认知状态转换神经机制中的重要性,为该领域未来研究奠定基础。

原文摘要 · Abstract (English)

Deep neural network (DNN) models have demonstrated impressive performance in various domains, yet their application in cognitive neuroscience is limited due to their lack of interpretability. In this study we employ two structurally different and complementary DNN-based models, a one-dimensional convolutional neural network (1D-CNN) and a bidirectional long short-term memory network (BiLSTM), to classify individual cognitive states from fMRI BOLD data, with a focus on understanding the cognitive underpinnings of the classification decisions. We show that despite the architectural differences, both models consistently produce a robust relationship between prediction accuracy and individual cognitive performance, such that low performance leads to poor prediction accuracy. To achieve model explainability, we used permutation techniques to calculate feature importance, allowing us to identify the most critical brain regions influencing model predictions. Across models, we found the dominance of visual networks, suggesting that task-driven state differences are primarily encoded in visual processing. Attention and control networks also showed relatively high importance, however, default mode and temporal-parietal networks demonstrated negligible contribution in differentiating cognitive states. Additionally, we observed individual trait-based effects and subtle model-specific differences, such that 1D-CNN showed slightly better overall performance, while BiLSTM showed better sensitivity for individual behavior; these initial findings require further research and robustness testing to be fully established. Our work underscores the importance of explainable DNN models in uncovering the neural mechanisms underlying cognitive state transitions, providing a foundation for future work in this domain.

fMRI深度学习认知神经科学可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。