用深度学习实现脑电到文本的开放词汇生成,支持个性化沟通。
Bridging Brain Signals and Language: A Deep Learning Approach to EEG-to-Text Decoding
- 融合个体脑信号与自然语言处理,突破封闭词表限制。
- 在ZuCo数据集上,BLEU、ROUGE和BERTScore均优于现有方法。
- 适合脑机接口、残障人士通信及个性化人机交互研究者。
将脑活动转化为人类语言,有望革新人机交互,并为言语障碍者提供沟通支持。尽管电子解码已取得一定进展,但当前的脑电图(EEG)到文本的解码方法仍难以实现开放词汇和深层语义理解,且受个体脑特征差异影响。本文提出一种新框架,通过结合个体特定学习模型与自然语言处理技术,突破传统封闭词表解码的局限。该方法采用深度表征学习提取关键脑电信号特征,训练神经网络生成超越原始数据内容的复杂句子。在ZuCo数据集上的分析表明,该方法在BLEU、ROUGE和BERTScore指标上均优于现有方法。研究验证了该框架在生成语义准确、语法正确文本方面的有效性,并能适应个体脑信号差异。本研究旨在连接开放词汇文本生成系统与脑信号解析,推动高效脑-文本系统的开发。研究成果具有跨学科意义,促进了创新辅助技术与个性化通信系统的发展,拓展了人机交互在多种场景中的可能性。
原文摘要 · Abstract (English)
Brain activity translation into human language delivers the capability to revolutionize machine-human interaction while providing communication support to people with speech disability. Electronic decoding reaches a certain level of achievement yet current EEG-to-text decoding methods fail to reach open vocabularies and depth of meaning and individual brain-specific variables. We introduce a special framework which changes conventional closed-vocabulary EEG-to-text decoding approaches by integrating subject-specific learning models with natural language processing methods to resolve detection obstacles. This method applies a deep representation learning approach to extract important EEG features which allow training of neural networks to create elaborate sentences that extend beyond original data content. The ZuCo dataset analysis demonstrates that research findings achieve higher BLEU, ROUGE and BERTScore performance when compared to current methods. The research proves how this framework functions as an effective approach to generate meaningful and correct texts while understanding individual brain variations. The proposed research aims to create a connection between open-vocabulary Text generation systems and human brain signal interpretation for developing efficacious brain-to-text systems. The research produces interdisciplinary effects through innovative assistive technology development and personalized communication systems which extend possibilities for human-computer interaction in various settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。