用大模型实现无需校准的脑机接口,开机即用
Leveraging Foundation Models for Calibration-Free c-VEP BCIs
- 用其他人的数据训练大模型,直接部署到新用户
- 零校准下准确率超68%,接近原系统11分钟校准效果
- 仅需43秒少量数据,准确率就达92%,适合临床应用
过去五年,基础模型(FMs)在计算机视觉和自然语言处理等领域迅速兴起。脑-机接口(BCI)也因支持重度残疾人群体而受到关注。在各类BCI范式中,编码调制视觉诱发电位(c-VEP)虽具有高信息传输速率和大目标选择容量,却因需要长时间校准而未被充分研究。本研究首次将基础模型应用于c-VEP BCI系统,以消除冗长校准需求。我们评估了两种方法:(1)完全无校准,不依赖任何个体数据;(2)有限校准,测试逐步加入校准数据的效果。两种情况下,分类头均在他人数据上训练。对于新用户,零校准设置下无需校准数据,系统可即插即用。该方法在两个c-VEP数据集上验证:在第一个数据集(n=17)上,零校准平均准确率为68.8% ± 17.6%,与原始研究全校准结果(66.2% ± 13.8%,约11分钟校准)相当;在第二个数据集(n=12)上,零校准准确率为71.8% ± 20.2%,优于原研究校准结果(93.7% ± 5.5%,约3.5分钟校准)。使用仅20%校准数据(约43秒)的有限校准方案,准确率达92% ± 5.2%。结果表明,基于基础模型的方法能有效消除或显著减少对长时间校准的需求。
原文摘要 · Abstract (English)
Foundation Models (FMs) have surged in popularity over the past five years, with applications spanning fields from computer vision to natural language processing. Brain-Computer Interfaces (BCIs) have also gained momentum due to their potential to support individuals with complex disabilities. Among BCI paradigms, code-modulated Visual Evoked Potentials (c-VEPs) remain relatively understudied, despite offering high information transfer rates and large selection target capacities. However, c-VEP systems require lengthy calibration sessions, limiting their practicality outside of laboratory settings. In this study, we use a FM for the first time to eliminate the need for lengthy calibration in c-VEP BCI systems. We evaluated two approaches: (1) a truly calibration-free approach requiring no subject-specific data, and (2) a limited calibration approach, where we assessed the benefit of incorporating incremental amounts of calibration data. In both cases, a classification head is trained on data from other subjects. For a new subject, no calibration data is required in the calibration-free setup, making the c-VEP system effectively plug-and-play. The proposed method was tested on two c-VEP datasets. For the calibration-free approach, the average accuracy on the first dataset (n = 17) was 68.8% +/- 17.6%, comparable to the full-calibration performance reported in the original study (66.2% +/- 13.8%), which required approximately 11 minutes of calibration. On the second dataset (n = 12), the calibration-free accuracy was 71.8% +/- 20.2%, versus 93.7% +/- 5.5% from the original study, which required around 3.5 minutes. A limited-calibration approach using only 20% of the subject's data (approximately 43 seconds) yielded 92% +/- 5.2% accuracy. These results indicate that our FM-based approach can effectively eliminate or significantly reduce the need for lengthy calibration in c-VEP BCIs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。