arXiv:2412.17824eess.SPcs.CL2024-12被引 1

用128通道脑电数据识别内心言语,准确率达81.13%

Ensemble Machine Learning Model for Inner Speech Recognition: A Subject-Specific Investigation

  • 构建集成学习模型,融合五种最优逻辑回归模型提升分类性能
  • 在西班牙10名受试者上实现81.13%准确率与81.12%F1值
  • 适用于神经康复与脑机接口研究,适合关注个体化脑信号分析者

近年来,内心言语识别因在康复、辅助技术及认知评估中的应用而备受关注。由于语言与语音生成过程复杂,识别其中成分仍具挑战。此前已有多种方法尝试,但新方法仍有探索空间。个体化分析对理解内心言语产生的脑动态机制至关重要,可为神经科学研究提供新思路。本研究使用公开的Thinking Out Loud数据集,基于128通道头皮脑电(EEG)信号,对10名西班牙受试者在默念四个词(Arriba, Abajo, Derecha, Izquierda)时的内心言语进行分类。采用统计方法去除运动伪影,提取每通道191个时域、频域及时频域特征。对比八种特征选择算法,选取最优方案;评估六种机器学习模型,并提出集成模型。深度学习模型也一并测试,结果与传统机器学习方法比较。所提集成模型通过堆叠五个最佳逻辑回归模型,在四类内心言语分类中达到81.13%总体准确率和81.12%F1分数,表明该框架在头皮脑电上识别内心言语具有潜力。

原文摘要 · Abstract (English)

Inner speech recognition has gained enormous interest in recent years due to its applications in rehabilitation, developing assistive technology, and cognitive assessment. However, since language and speech productions are a complex process, for which identifying speech components has remained a challenging task. Different approaches were taken previously to reach this goal, but new approaches remain to be explored. Also, a subject-oriented analysis is necessary to understand the underlying brain dynamics during inner speech production, which can bring novel methods to neurological research. A publicly available dataset, Thinking Out Loud Dataset, has been used to develop a Machine Learning (ML)-based technique to classify inner speech using 128-channel surface EEG signals. The dataset is collected on a Spanish cohort of ten subjects while uttering four words (Arriba, Abajo, Derecha, and Izquierda) by each participant. Statistical methods were employed to detect and remove motion artifacts from the Electroencephalography (EEG) signals. A large number (191 per channel) of time-, frequency- and time-frequency-domain features were extracted. Eight feature selection algorithms are explored, and the best feature selection technique is selected for subsequent evaluations. The performance of six ML algorithms is evaluated, and an ensemble model is proposed. Deep Learning (DL) models are also explored, and the results are compared with the classical ML approach. The proposed ensemble model, by stacking the five best logistic regression models, generated an overall accuracy of 81.13% and an F1 score of 81.12% in the classification of four inner speech words using surface EEG signals. The proposed framework with the proposed ensemble of classical ML models shows promise in the classification of inner speech using surface EEG signals.

脑机接口内心言语机器学习脑电分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。