arXiv:2411.15395cs.HCcs.AI2024-11被引 6

用大模型预测用户输入,让脑机接口打字更快更省力。

ChatBCI: A P300 Speller BCI Leveraging Large Language Models for Improved Sentence Composition in Realistic Scenarios

  • 通过调用GPT-3.5远程生成词建议,实现多词预测
  • 实测打字速度达8.53字符/分钟,节省53%以上按键
  • 无需本地训练,适合有沟通障碍的用户实时交流

P300拼写脑机接口(BCI)通过检测用户在视觉刺激下的脑电P300成分,实现逐字或首字母选择以拼写句子。传统方法需逐字输入,导致操作耗时、认知负荷高。本文提出ChatBCI,利用大语言模型(LLM)的零样本学习能力,基于用户输入的初始字母自动推荐词汇或预测后续词语,显著减少按键次数。系统通过远程调用GPT-3.5 API获取建议,并设计新图形界面将建议词作为额外按键显示。采用SWLDA进行P300分类。七名受试者完成两项在线任务:1)使用ChatBCI复现自编句子;2)根据建议即兴造句。结果表明,在任务1中,相比传统逐字拼写,平均节省62.14%时间与53.22%按键,信息传输率提升198.96%;在任务2中,按键节省率达80.68%,打字速度达8.53字符/分钟。该系统通过远程调用大模型,无需本地训练与存储,显著提升真实场景下句子生成效率,为残障人士实时沟通提供高效解决方案。

原文摘要 · Abstract (English)

P300 speller BCIs allow users to compose sentences by selecting target keys on a GUI through the detection of P300 component in their EEG signals following visual stimuli. Most P300 speller BCIs require users to spell words letter by letter, or the first few initial letters, resulting in high keystroke demands that increase time, cognitive load, and fatigue. This highlights the need for more efficient, user-friendly methods for faster sentence composition. In this work, we introduce ChatBCI, a P300 speller BCI that leverages the zero-shot learning capabilities of large language models (LLMs) to suggest words from user-spelled initial letters or predict the subsequent word(s), reducing keystrokes and accelerating sentence composition. ChatBCI retrieves word suggestions through remote queries to the GPT-3.5 API. A new GUI, displaying GPT-3.5 word suggestions as extra keys is designed. SWLDA is used for the P300 classification. Seven subjects completed two online spelling tasks: 1) copy-spelling a self-composed sentence using ChatBCI, and 2) improvising a sentence using ChatBCI's word suggestions. Results demonstrate that in Task 1, on average, ChatBCI outperforms letter-by-letter BCI spellers, reducing time and keystrokes by 62.14% and 53.22%, respectively, and increasing information transfer rate by 198.96%. In Task 2, ChatBCI achieves 80.68% keystroke savings and a record 8.53 characters/min for typing speed. Overall, ChatBCI, by employing remote LLM queries, enhances sentence composition in realistic scenarios, significantly outperforming traditional spellers without requiring local model training or storage. ChatBCI's (multi-) word predictions, combined with its new GUI, pave the way for developing next-generation speller BCIs that are efficient and effective for real-time communication, especially for users with communication and motor disabilities.

脑机接口大模型打字加速无障碍通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。