arXiv:2409.00035eess.SPcs.HC2024-09被引 14

用脑电波识别左右手动作,实现高准确率虚拟键盘输入。

EEG Right & Left Voluntary Hand Movement-based Virtual Brain-Computer Interfacing Keyboard Using Hybrid Deep Learning Approach

  • 结合BiGRU与注意力机制,提升脑电信号分类能力。
  • 10折交叉验证平均准确率达91%,测试准确率90%。
  • 可实时运行于图形界面,适合运动障碍者使用。

基于脑机接口(BMI)的脑电图(EEG)技术为运动障碍患者提供了潜在帮助。然而,由于脑活动的复杂性和变异性,可靠解析特定任务(如模拟按键)的EEG信号仍存在挑战。现有方法在自适应性、可用性和鲁棒性方面受限,尤其在虚拟键盘应用中表现不足。为此,本文提出一种基于右/左自愿手部运动的EEG-BMI系统,利用公开数据集进行预处理:带通滤波后分割为22通道阵列,提取事件相关电位(ERP)窗口,生成19×200特征数组,分为三类:静息态(0)、'd'键按下(1)、'l'键按下(2)。采用融合BiGRU与注意力机制的混合神经网络模型,在10折分层交叉验证中达到91%平均准确率,测试准确率达90%,优于支持向量机(SVM)、朴素贝叶斯、Transformer、CNN-Transformer混合架构及EEGNet等模型。最终,该模型集成至实时图形用户界面(GUI),实现从脑电活动中模拟并预测按键操作。研究表明,深度学习能有效提升EEG-BMI系统的信号解析与分类性能。

原文摘要 · Abstract (English)

Brain-machine interfaces (BMIs), particularly those based on electroencephalography (EEG), offer promising solutions for assisting individuals with motor disabilities. However, challenges in reliably interpreting EEG signals for specific tasks, such as simulating keystrokes, persist due to the complexity and variability of brain activity. Current EEG-based BMIs face limitations in adaptability, usability, and robustness, especially in applications like virtual keyboards, as traditional machine-learning models struggle to handle high-dimensional EEG data effectively. To address these gaps, we developed an EEG-based BMI system capable of accurately identifying voluntary keystrokes, specifically leveraging right and left voluntary hand movements. Using a publicly available EEG dataset, the signals were pre-processed with band-pass filtering, segmented into 22-electrode arrays, and refined into event-related potential (ERP) windows, resulting in a 19x200 feature array categorized into three classes: resting state (0), 'd' key press (1), and 'l' key press (2). Our approach employs a hybrid neural network architecture with BiGRU-Attention as the proposed model for interpreting EEG signals, achieving superior test accuracy of 90% and a mean accuracy of 91% in 10-fold stratified cross-validation. This performance outperforms traditional ML methods like Support Vector Machines (SVMs) and Naive Bayes, as well as advanced architectures such as Transformers, CNN-Transformer hybrids, and EEGNet. Finally, the BiGRU-Attention model is integrated into a real-time graphical user interface (GUI) to simulate and predict keystrokes from brain activity. Our work demonstrates how deep learning can advance EEG-based BMI systems by addressing the challenges of signal interpretation and classification.

脑机接口脑电信号深度学习虚拟键盘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。