arXiv:2412.15560q-bio.NCcs.LG2024-12被引 3

用神经网络表征指导脑电识别音乐,提升解码准确率

Predicting Artificial Neural Network Representations to Learn Recognition Model for Music Identification from Brain Recordings

  • 以ANN表征为监督信号,训练脑电音乐识别模型
  • 模型分类准确率显著提升,验证了脑-网表征相似性
  • 适合脑机接口与音乐认知研究者参考

近期研究表明,人工神经网络(ANN)在相同听觉刺激下的表征与皮层表征具有显著相似性。本研究反向利用这一现象:以ANN表征作为监督信号,基于非侵入式脑电(EEG)记录训练音乐识别模型。实验中,通过让EEG模型预测与音乐识别相关的ANN表征,实现了分类准确率的显著提升。该方法为外部听觉刺激下的脑记录识别模型开发提供了新范式,有助于推进脑机接口、神经解码技术及音乐认知研究,并深化对听觉脑活动与ANN表征关系的理解。

原文摘要 · Abstract (English)

Recent studies have demonstrated that the representations of artificial neural networks (ANNs) can exhibit notable similarities to cortical representations when subjected to identical auditory sensory inputs. In these studies, the ability to predict cortical representations is probed by regressing from ANN representations to cortical representations. Building upon this concept, our approach reverses the direction of prediction: we utilize ANN representations as a supervisory signal to train recognition models using noisy brain recordings obtained through non-invasive measurements. Specifically, we focus on constructing a recognition model for music identification, where electroencephalography (EEG) brain recordings collected during music listening serve as input. By training an EEG recognition model to predict ANN representations-representations associated with music identification-we observed a substantial improvement in classification accuracy. This study introduces a novel approach to developing recognition models for brain recordings in response to external auditory stimuli. It holds promise for advancing brain-computer interfaces (BCI), neural decoding techniques, and our understanding of music cognition. Furthermore, it provides new insights into the relationship between auditory brain activity and ANN representations.

脑机接口音乐识别神经解码脑电

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。