用注意力图分析脑电特征,揭示说话与听觉任务的神经机制
Feature Estimation of Global Language Processing in EEG Using Attention Maps
- 通过视觉变换器和EEGNet的注意力权重定位关键脑电特征
- EEGNet在区分听与说任务上表现最优,跨被试泛化性强
- 融合梅尔频谱可提升时频特征分辨率,适合认知神经研究
理解脑电(EEG)特征与认知任务之间的关联对揭示脑功能至关重要。在说话与听觉任务中,大脑活动呈现同步性。然而,利用空间分辨率低但时间分辨率高的方法(如EEG)而非高空间分辨率的方法(如fMRI),仍难以准确估计任务依赖的大脑活动特征。本研究提出一种新方法,借助深度学习模型的权重探索该关联。结果表明,来自视觉变换器(Vision Transformers)和EEGNet生成的注意力图能有效识别与已有研究一致的特征。其中,EEGNet在跨被试独立性和听觉/说话任务分类方面表现最佳。将梅尔频谱(Mel-Spectrogram)应用于视觉变换器可增强时频相关脑电信号的分辨能力。研究发现,注意力图所揭示的特征特性高度依赖输入数据,支持针对不同信号定制特征提取策略。通过特征估计,本研究不仅验证了已知属性,还预测了新特征,可能为脑电在医学中的应用(如早期疾病检测)提供新视角。这些技术将显著推动认知神经科学的发展。
原文摘要 · Abstract (English)
Understanding the correlation between EEG features and cognitive tasks is crucial for elucidating brain function. Brain activity synchronizes during speaking and listening tasks. However, it is challenging to estimate task-dependent brain activity characteristics with methods with low spatial resolution but high temporal resolution, such as EEG, rather than methods with high spatial resolution, like fMRI. This study introduces a novel approach to EEG feature estimation that utilizes the weights of deep learning models to explore this association. We demonstrate that attention maps generated from Vision Transformers and EEGNet effectively identify features that align with findings from prior studies. EEGNet emerged as the most accurate model regarding subject independence and the classification of Listening and Speaking tasks. The application of Mel-Spectrogram with ViTs enhances the resolution of temporal and frequency-related EEG characteristics. Our findings reveal that the characteristics discerned through attention maps vary significantly based on the input data, allowing for tailored feature extraction from EEG signals. By estimating features, our study reinforces known attributes and predicts new ones, potentially offering fresh perspectives in utilizing EEG for medical purposes, such as early disease detection. These techniques will make substantial contributions to cognitive neuroscience.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。