arXiv:2510.21038cs.LG2025-10被引 3

用脑电数据实现关键词识别,兼顾隐私与实用。

Elementary, My Dear Watson: Non-Invasive Neural Keyword Spotting in the LibriBrain Dataset

  • 基于52小时脑电数据构建关键词识别基准任务
  • 模型在保留测试集上比随机基线提升13倍AUPRC
  • 适合脑机接口、神经解码方向研究者快速上手

非侵入式脑机接口正受益于大型公开基准数据集,但现有基准多聚焦于语音检测、音素分类等基础任务,而脑到文本等实际应用仍难实现。本文提出关键词检测(KWS)作为兼具实用性与隐私保护的中间任务。基于深度52小时、受试者内结构的LibriBrain语料库,我们提供标准化训练/验证/测试划分,采用针对极端类别不平衡设计的评估协议。具体使用精确率-召回率曲线下面积(AUPRC)作为稳健评估指标,并辅以固定召回率下的每小时误报次数(FA/h)衡量用户体验权衡。为促进部署与社区实验,我们发布了更新版pnpl库,包含词级数据加载器和Colab教程。作为初始基准模型,我们提出一个轻量级一维卷积/残差网络,结合焦点损失与top-k池化,可在单块消费级显卡上训练。该模型在保留会话上实现约13倍于置换基线的AUPRC,证明了任务可行性。探索性分析显示:(i) 受试者内性能随训练时长呈对数线性增长;(ii) 词语频率与持续时间是影响可检测性的系统性因素。

原文摘要 · Abstract (English)

Non-invasive brain-computer interfaces (BCIs) are beginning to benefit from large, public benchmarks. However, current benchmarks target relatively simple, foundational tasks like Speech Detection and Phoneme Classification, while application-ready results on tasks like Brain-to-Text remain elusive. We propose Keyword Spotting (KWS) as a practically applicable, privacy-aware intermediate task. Using the deep 52-hour, within-subject LibriBrain corpus, we provide standardized train/validation/test splits for reproducible benchmarking, and adopt an evaluation protocol tailored to extreme class imbalance. Concretely, we use area under the precision-recall curve (AUPRC) as a robust evaluation metric, complemented by false alarms per hour (FA/h) at fixed recall to capture user-facing trade-offs. To simplify deployment and further experimentation within the research community, we are releasing an updated version of the pnpl library with word-level dataloaders and Colab-ready tutorials. As an initial reference model, we present a compact 1-D Conv/ResNet baseline with focal loss and top-k pooling that is trainable on a single consumer-class GPU. The reference model achieves approximately 13x the permutation baseline AUPRC on held-out sessions, demonstrating the viability of the task. Exploratory analyses reveal: (i) predictable within-subject scaling - performance improves log-linearly with more training hours - and (ii) the existence of word-level factors (frequency and duration) that systematically modulate detectability.

脑机接口关键词识别神经解码隐私计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。