首次同步采集说话时的脑电、肌电和实时核磁,揭示言语产生全过程。
An Approach to Simultaneous Acquisition of Real-Time MRI Video, EEG, and Surface EMG for Articulatory, Brain, and Muscle Activity During Speech Production
- 设计专用去噪流程,解决核磁干扰与肌电伪影问题。
- 实现脑信号、肌肉活动与发音动作的实时同步记录。
- 为语言神经科学与脑机接口提供全新数据支持。
言语产生是一个涵盖神经规划、运动控制、肌肉激活和发音运动的复杂过程。尽管语音信号是最易获取的言语产物,但无法直接揭示其神经生理基础。本文首次实现了动态核磁(MRI)、脑电(EEG)与表面肌电(sEMG)的同步采集,捕捉了言语生产链中的关键环节:脑信号、肌肉激活与发音运动。该多模态采集面临严重技术挑战,包括核磁诱发的电磁干扰及肌源性伪影。为此,我们提出一种针对三模态场景的伪影抑制方法。未来该框架将为言语神经科学提供前所未有的洞察,并推动脑机接口发展。源代码与数据已公开。
原文摘要 · Abstract (English)
Speech production is a complex process spanning neural planning, motor control, muscle activation, and articulatory kinematics. While the acoustic speech signal is the most accessible product of the speech production act, it does not directly reveal its causal neurophysiological substrates. We present the first simultaneous acquisition of real-time (dynamic) MRI, EEG, and surface EMG, capturing several key aspects of the speech production chain: brain signals, muscle activations, and articulatory movements. This multimodal acquisition paradigm presents substantial technical challenges, including MRI-induced electromagnetic interference and myogenic artifacts. To mitigate these, we introduce an artifact suppression pipeline tailored to this tri-modal setting. Once fully developed, this framework is poised to offer an unprecedented window into speech neuroscience and insights leading to brain-computer interface advances. The source code and data are available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。