arXiv:2506.18749cs.HCcs.AI2025-06中稿 · IJCNN 2025

用脑电+语音控制假肢,实时响应且准确率高达96%。

BRAVE: Brain-Controlled Prosthetic Arm with Voice Integration and Embodied Learning for Enhanced Mobility

  • 融合脑电与语音,通过集成学习提升意图识别准确率。
  • 系统实时响应仅150毫秒,跨用户测试准确率达96%。
  • 无需残余肌肉信号,适合无肌电残留的截肢者使用。

非侵入式脑机接口有望为上肢截肢者提供直观的假肢控制。然而,现有基于脑电图(EEG)的控制系统存在信号噪声大、分类准确率低和实时适应性差等问题。本文提出BRAVE,一种结合脑电与语音控制的混合假肢系统,采用集成学习的脑电分类方法,并引入人机协同纠错框架以增强响应性。与依赖残余肌电信号的传统肌电(EMG)控制不同,BRAVE直接解析脑电驱动的运动意图,实现不依赖肌肉活动的运动控制。为提升分类鲁棒性,系统整合LSTM、CNN与随机森林模型,整体分类准确率达96%。脑电信号经0.5–45 Hz带通滤波、独立成分分析(ICA)去伪影及共空间模式(CSP)特征提取,有效降低肌电(EMG)和眼电(EOG)信号干扰。同时,系统集成自动语音识别(ASR),实现对假肢多自由度(DOF)模式的直观切换。系统响应延迟仅为150毫秒,依托实验室流层(LSL)网络实现实时同步数据采集。在自研假肢平台与多名受试者上的评估验证了系统的跨用户泛化能力。系统优化为低功耗嵌入式部署,适用于真实场景应用,无需高性能计算环境。结果表明,BRAVE为高鲁棒性、实时性的非侵入式假肢控制提供了可行路径。

原文摘要 · Abstract (English)

Non-invasive brain-computer interfaces (BCIs) have the potential to enable intuitive control of prosthetic limbs for individuals with upper limb amputations. However, existing EEG-based control systems face challenges related to signal noise, classification accuracy, and real-time adaptability. In this work, we present BRAVE, a hybrid EEG and voice-controlled prosthetic system that integrates ensemble learning-based EEG classification with a human-in-the-loop (HITL) correction framework for enhanced responsiveness. Unlike traditional electromyography (EMG)-based prosthetic control, BRAVE aims to interpret EEG-driven motor intent, enabling movement control without reliance on residual muscle activity. To improve classification robustness, BRAVE combines LSTM, CNN, and Random Forest models in an ensemble framework, achieving a classification accuracy of 96% across test subjects. EEG signals are preprocessed using a bandpass filter (0.5-45 Hz), Independent Component Analysis (ICA) for artifact removal, and Common Spatial Pattern (CSP) feature extraction to minimize contamination from electromyographic (EMG) and electrooculographic (EOG) signals. Additionally, BRAVE incorporates automatic speech recognition (ASR) to facilitate intuitive mode switching between different degrees of freedom (DOF) in the prosthetic arm. The system operates in real time, with a response latency of 150 ms, leveraging Lab Streaming Layer (LSL) networking for synchronized data acquisition. The system is evaluated on an in-house fabricated prosthetic arm and on multiple participants highlighting the generalizability across users. The system is optimized for low-power embedded deployment, ensuring practical real-world application beyond high-performance computing environments. Our results indicate that BRAVE offers a promising step towards robust, real-time, non-invasive prosthetic control.

脑机接口假肢控制语音交互实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。