arXiv:2412.08971cs.RO2024-12被引 5

用低成本脑机接口实现机器人多日稳定意念操控

Motor Imagery Teleoperation of a Mobile Robot Using a Low-Cost Brain-Computer Interface for Multi-Day Validation

论文配图:Motor Imagery Teleoperation of a Mobile Robot Using a Low-Cost Brain-Computer Interface for Multi-Day Validation
图 1 · 摘自论文原文
  • 用滑动窗口+微调DNN替代复杂特征提取,实时控制机器人
  • 三日验证中准确率维持75%,训练数据减少70%
  • 适合想在真实场景中用意念控机器人的研究者和开发者

脑机接口(BCI)有望在假肢、辅助技术(轮椅)、机器人和人机交互中实现革命性控制。尽管运动想象(MI)提供了直观的BCI控制方式,但其实际应用常受限于昂贵设备、大量训练数据和复杂算法,导致用户疲劳并降低可及性。本文展示,通过微调的深度神经网络(DNN)结合滑动窗口,可在无需复杂特征提取的情况下实现真实场景中移动机器人的有效MI-BCI控制。微调优化了DNN的卷积与注意力层,以适应用户每日的运动想象数据流,使训练数据减少70%,并减轻用户长时间采集数据的疲劳。使用成本约3000美元、16通道、非侵入式开源脑电图(EEG)设备,四名用户在三天内远程操控四足机器人。系统在单日验证集上达到78%准确率,并在三日内保持75%验证准确率,无需每日大量重新训练。在真实世界机器人指令分类中,平均准确率达62%。本工作实证表明,通过减少训练数据和使用低成本EEG设备,MI-BCI系统可在多日间维持性能,显著提升脑机接口技术的实用性与可及性,使其更适用于真实场景中的机器人控制。

原文摘要 · Abstract (English)

Brain-computer interfaces (BCI) have the potential to provide transformative control in prosthetics, assistive technologies (wheelchairs), robotics, and human-computer interfaces. While Motor Imagery (MI) offers an intuitive approach to BCI control, its practical implementation is often limited by the requirement for expensive devices, extensive training data, and complex algorithms, leading to user fatigue and reduced accessibility. In this paper, we demonstrate that effective MI-BCI control of a mobile robot in real-world settings can be achieved using a fine-tuned Deep Neural Network (DNN) with a sliding window, eliminating the need for complex feature extractions for real-time robot control. The fine-tuning process optimizes the convolutional and attention layers of the DNN to adapt to each user's daily MI data streams, reducing training data by 70% and minimizing user fatigue from extended data collection. Using a low-cost (~$3k), 16-channel, non-invasive, open-source electroencephalogram (EEG) device, four users teleoperated a quadruped robot over three days. The system achieved 78% accuracy on a single-day validation dataset and maintained a 75% validation accuracy over three days without extensive retraining from day-to-day. For real-world robot command classification, we achieved an average of 62% accuracy. By providing empirical evidence that MI-BCI systems can maintain performance over multiple days with reduced training data to DNN and a low-cost EEG device, our work enhances the practicality and accessibility of BCI technology. This advancement makes BCI applications more feasible for real-world scenarios, particularly in controlling robotic systems.

脑机接口意念控制低代码机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。