用脑电错误信号驱动强化学习,让脑机接口自动适应用户状态变化。
Error-related Potential driven Reinforcement Learning for adaptive Brain-Computer Interfaces
- 基于错误相关电位与强化学习,实现脑机接口动态自适应。
- 在公开数据集和快节奏游戏中均保持稳定控制性能。
- 揭示高速任务下运动想象效果差,提示实际应用中的设计限制。
脑机接口(BCI)为运动障碍者提供替代性交互方式,其中基于脑电图(EEG)的非侵入式系统因安全性和实用性广受关注。然而,由于心理状态或电极阻抗等导致的脑电信号非平稳性,其性能常受影响。为此,研究聚焦于自适应BCI。近年来,利用错误相关电位(ErrPs)提升性能成为热点,该信号可非侵入检测,并用于纠错或自适应调节。本文提出一种新型基于强化学习(RL)的自适应ErrP-BCI框架,结合了运动想象与误差信号。通过两个RL智能体动态适应脑电非平稳性。在公开的运动想象数据集及快节奏游戏任务中验证,结果表明该框架能从用户交互中学习控制策略,在不同数据集上表现稳健。但游戏实验发现,高速交互场景下运动想象对参与者基本无效,暴露出任务设计在实时BCI应用中的局限性。研究证实了强化学习在自适应BCI中的潜力,也指出了任务复杂度与用户响应之间的现实约束。
原文摘要 · Abstract (English)
Brain-computer interfaces (BCIs) provide alternative communication methods for individuals with motor disabilities by allowing control and interaction with external devices. Non-invasive BCIs, especially those using electroencephalography (EEG), are practical and safe for various applications. However, their performance is often hindered by EEG non-stationarities, caused by changing mental states or device characteristics like electrode impedance. This challenge has spurred research into adaptive BCIs that can handle such variations. In recent years, interest has grown in using error-related potentials (ErrPs) to enhance BCI performance. ErrPs, neural responses to errors, can be detected non-invasively and have been integrated into different BCI paradigms to improve performance through error correction or adaptation. This research introduces a novel adaptive ErrP-based BCI approach using reinforcement learning (RL). We demonstrate the feasibility of an RL-driven adaptive framework incorporating ErrPs and motor imagery. Utilizing two RL agents, the framework adapts dynamically to EEG non-stationarities. Validation was conducted using a publicly available motor imagery dataset and a fast-paced game designed to boost user engagement. Results show the framework's promise, with RL agents learning control policies from user interactions and achieving robust performance across datasets. However, a critical insight from the game-based protocol revealed that motor imagery in a high-speed interaction paradigm was largely ineffective for participants, highlighting task design limitations in real-time BCI applications. These findings underscore the potential of RL for adaptive BCIs while pointing out practical constraints related to task complexity and user responsiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。