用强化学习修正脑机接口的运动预测误差,提升控制精度。
Learning Residual Kinematic Corrections for Continuous Neural Decoding via Reinforcement Learning

- 用强化学习对卷积网络-长短期记忆模型的输出进行残差修正。
- 2D和虚拟现实场景下相关系数提升41.5%和21.2%,误差降低超38%。
- 离线训练无需额外脑电数据,适合神经康复与假肢控制应用。
通过非侵入式脑电图(EEG)解码连续三维(3D)运动想象(MI)仍面临信号变异和残余解码误差的挑战。深度学习模型如卷积神经网络-长短期记忆(CNN-LSTM)虽能捕捉时空动态,但预测轨迹中仍存在系统性残差误差。本文提出两阶段解码框架,利用强化学习(RL)对CNN-LSTM解码器输出进行残差运动学修正(CNN-LSTM-RL)。RL代理在离线状态下训练,不直接使用脑电信号,而是基于预测轨迹优化与目标轨迹的运动准确性。解码性能以皮尔逊相关系数(r)和均方根误差(RMSE)衡量。相较于单独使用CNN-LSTM,CNN-LSTM-RL在2D场景下平均相关系数从0.5076提升至0.7181(p=0.0005),VR场景下从0.6420升至0.7780(p=0.0059),相对提升分别为41.5%和21.2%;对应RMSE由0.0890降至0.0532(2D,p<0.0001),由0.0714降至0.0441(VR,p<0.0001),相对减少40.2%和38.2%。结果表明,该可扩展框架通过离线残差强化学习有效提升了3D BCI MI解码性能,无需额外神经数据,推动神经康复、假肢控制与虚拟交互发展。
原文摘要 · Abstract (English)
Decoding continuous three-dimensional (3D) motor imagery (MI) using non-invasive electroencephalography (EEG)-based brain--computer interfaces (BCIs) remains challenging due to signal variability and residual decoding errors. Deep learning architectures such as convolutional neural network--long short-term memory (CNN--LSTM) models can capture spatial and temporal dynamics for continuous kinematic decoding; however, systematic residual errors persist in predicted trajectories. We propose a two-stage decoding framework that applies reinforcement learning (RL) to perform residual kinematic correction on the outputs of a CNN--LSTM decoder (CNN--LSTM--RL). The RL agent is trained offline without direct EEG input and instead operates on predicted kinematic trajectories to optimize movement accuracy relative to target trajectories. Decoding performance was quantified using Pearson correlation coefficients ($r$) and Root Mean Square Errors (RMSE) along the $x, y$, and $z$ axes. Compared to CNN--LSTM applied alone, CNN--LSTM--RL improved the mean correlation from $0.5076$ to $0.7181$ ($p = 0.0005$) in 2D and from $0.6420$ to $0.7780$ ($p = 0.0059$) in VR, with relative gains of $41.5\%$ and $21.2\%$, respectively. Correspondingly, RMSE was reduced from $0.0890$ to $0.0532$ (2D, $p < 0.0001$) and from $0.0714$ to $0.0441$ (VR, $p < 0.0001$), representing relative reductions of $40.2\%$ and $38.2\%$. These findings demonstrate that this scalable framework enhances 3D BCI MI decoding by correcting kinematic errors via offline residual RL without extra neural data, advancing neurorehabilitation, prosthetics, and virtual interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。