arXiv:2508.07731cs.HCcs.AI2025-08中稿 · 62nd DAC 2025被引 1

用脑电波实时控制假肢手臂,精度达90%且低延迟。

CognitiveArm: Enabling Real-Time EEG-Controlled Prosthetic Arm Using Embodied Machine Learning

  • 基于进化搜索优化深度学习模型,在嵌入式设备上实现实时处理。
  • 在资源受限硬件上实现90%准确率,支持三类动作分类。
  • 融合语音指令,可灵活切换模式,适合日常使用场景。

通过非侵入式脑机接口(BCI)高效控制假肢肢体,需在边缘AI硬件上实时完成脑电图(EEG)预处理、特征提取与动作预测。我们提出CognitiveArm系统,基于嵌入式AI硬件实现脑控假肢实时运行,兼顾准确性与效率。系统集成BrainFlow开源库用于EEG数据采集与流传输,并采用进化搜索方法,通过超参数调优、优化器分析与窗口选择,找到深度学习模型的帕累托最优配置。结合剪枝与量化等模型压缩技术,平衡计算效率与准确率。我们采集了专用EEG数据集并设计标注流程,精准标记对应特定意图的动作信号,支撑模型训练。系统支持语音命令实现模式无缝切换,控制假肢3个自由度。原型系统接入OpenBCI UltraCortex Mark IV EEG头戴设备,三类核心动作(左、右、空闲)分类准确率达90%。语音集成使多种复杂动作(如握手、取杯)可实现,显著提升实际应用性能,验证了该系统在高级假肢控制中的潜力。

原文摘要 · Abstract (English)

Efficient control of prosthetic limbs via non-invasive brain-computer interfaces (BCIs) requires advanced EEG processing, including pre-filtering, feature extraction, and action prediction, performed in real time on edge AI hardware. Achieving this on resource-constrained devices presents challenges in balancing model complexity, computational efficiency, and latency. We present CognitiveArm, an EEG-driven, brain-controlled prosthetic system implemented on embedded AI hardware, achieving real-time operation without compromising accuracy. The system integrates BrainFlow, an open-source library for EEG data acquisition and streaming, with optimized deep learning (DL) models for precise brain signal classification. Using evolutionary search, we identify Pareto-optimal DL configurations through hyperparameter tuning, optimizer analysis, and window selection, analyzed individually and in ensemble configurations. We apply model compression techniques such as pruning and quantization to optimize models for embedded deployment, balancing efficiency and accuracy. We collected an EEG dataset and designed an annotation pipeline enabling precise labeling of brain signals corresponding to specific intended actions, forming the basis for training our optimized DL models. CognitiveArm also supports voice commands for seamless mode switching, enabling control of the prosthetic arm's 3 degrees of freedom (DoF). Running entirely on embedded hardware, it ensures low latency and real-time responsiveness. A full-scale prototype, interfaced with the OpenBCI UltraCortex Mark IV EEG headset, achieved up to 90% accuracy in classifying three core actions (left, right, idle). Voice integration enables multiplexed, variable movement for everyday tasks (e.g., handshake, cup picking), enhancing real-world performance and demonstrating CognitiveArm's potential for advanced prosthetic control.

脑机接口假肢控制边缘计算实时处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。