arXiv:2602.06907cs.LG2026-02

用强化学习自动找到大脑节律最佳刺激时机,实现个性化脑刺激治疗。

A first realization of reinforcement learning-based closed-loop EEG-TMS

  • 用强化学习自动识别个体脑电节律中高/低兴奋性的最佳刺激相位。
  • 重复刺激高兴奋相位显著提升运动网络功能连接,低兴奋相位则降低。
  • 首次实现闭环脑电-磁刺激系统,适合神经调控与精准治疗研究者。

经颅磁刺激(TMS)是研究人脑神经生理和治疗脑疾病的重要工具。传统TMS采用统一参数,忽视个体差异。基于脑状态的脑电-TMS方法(如在感觉运动mu节律特定相位刺激)可诱导不同神经可塑性效应,但依赖人为预设目标相位。本文首次实现基于强化学习的闭环实时脑电-TMS系统,无需人工设定目标,自动识别25名受试者个体的mu节律中与高/低皮质脊髓兴奋性相关的相位。实验针对辅助运动区-初级运动皮层网络,利用线性混合效应模型与贝叶斯分析,发现强化学习识别出的相位反复刺激后,可导致该运动网络功能连接显著长期增强或减弱(以静息态脑电相干虚部衡量),且运动诱发电位幅度变化显著。结果证明闭环脑电-TMS在人类中的可行性,为脑疾病个体化治疗迈出关键一步。

原文摘要 · Abstract (English)

Background: Transcranial magnetic stimulation (TMS) is a powerful tool to investigate neurophysiology of the human brain and treat brain disorders. Traditionally, therapeutic TMS has been applied in a one-size-fits-all approach, disregarding inter- and intra-individual differences. Brain state-dependent EEG-TMS, such as coupling TMS with a pre-specified phase of the sensorimotor mu-rhythm, enables the induction of differential neuroplastic effects depending on the targeted phase. But this approach is still user-dependent as it requires defining an a-priori target phase. Objectives: To present a first realization of a machine-learning-based, closed-loop real-time EEG-TMS setup to identify user-independently the individual mu-rhythm phase associated with high- vs. low-corticospinal excitability states. Methods: We applied EEG-TMS to 25 participants targeting the supplementary motor area-primary motor cortex network and used a reinforcement learning algorithm to identify the mu-rhythm phase associated with high- vs. low corticospinal excitability. We employed linear mixed effects models and Bayesian analysis to determine effects of reinforced learning on corticospinal excitability indexed by motor evoked potential amplitude, and functional connectivity indexed by the imaginary part of resting-state EEG coherence. Results: Reinforcement learning effectively identified the mu-rhythm phase associated with high- vs. low-excitability states, and their repetitive stimulation resulted in long-term increases vs. decreases in functional connectivity in the stimulated sensorimotor network. Conclusions: We demonstrated for the first time the feasibility of closed-loop EEG-TMS in humans, a critical step towards individualized treatment of brain disorders.

脑机接口强化学习TMS闭环控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。