轻量扩散模型实现实时想象言语解码,助力失语症患者交流
Lightweight Diffusion-based Framework for Online Imagined Speech Decoding in Aphasia
- 设计双阶段框架,用轻量扩散模型实现低延迟解码
- 实时准确率达65%(顶1)和70%(顶2),部分类别达100%顶2准确率
- 专为临床需求定制任务,适合失语症康复的脑机接口应用
失语症患者在实时语言交流中面临严重困难,而现有想象言语解码方法多限于离线分析或计算开销大的模型。为此,我们提出一个两阶段实验框架:先离线采集数据,再进行在线反馈,实现实时想象言语解码。该范式采用四类韩语任务,包括根据患者日常沟通需求选定的三种想象言语目标和一种静息状态,针对一位慢性命名性失语症患者进行评估。在此框架下,我们引入一种轻量级扩散神经解码模型,通过降维、时序核优化、带正则化的组归一化及双重早停机制实现实时推理优化。在实时测试中,系统达到65%顶1准确率和70%顶2准确率,其中Water类别达80%顶1和100%顶2准确率。结果表明,经实时优化的扩散架构结合临床导向的任务设计,可为失语症患者的通信型脑机接口提供可行方案。
原文摘要 · Abstract (English)
Individuals with aphasia experience severe difficulty in real-time verbal communication, while most imagined speech decoding approaches remain limited to offline analysis or computationally demanding models. To address this limitation, we propose a two-session experimental framework consisting of an offline data acquisition phase and a subsequent online feedback phase for real-time imagined speech decoding. The paradigm employed a four-class Korean-language task, including three imagined speech targets selected according to the participant's daily communicative needs and a resting-state condition, and was evaluated in a single individual with chronic anomic aphasia. Within this framework, we introduce a lightweight diffusion-based neural decoding model explicitly optimized for real-time inference, achieved through architectural simplifications such as dimensionality reduction, temporal kernel optimization, group normalization with regularization, and dual early-stopping criteria. In real-time evaluation, the proposed system achieved 65\% top-1 and 70\% top-2 accuracy, with the Water class reaching 80\% top-1 and 100\% top-2 accuracy. These results demonstrate that real-time-optimized diffusion-based architectures, combined with clinically grounded task design, can support feasible online imagined speech decoding for communication-oriented BCI applications in aphasia.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。