用脑电预测语音可懂度,准确率达行为测试水平。
A Multi-decoder Neural Tracking Method for Accurately Predicting Speech Intelligibility
- 集成数百个解码器,融合不同语音特征与预处理方式
- 预测结果与行为测试相关性达0.647,误差均小于1 dB
- 仅需15分钟数据即可保持精度,适合临床实用
基于脑电的方法可预测语音可懂度,但其准确性和鲁棒性仍落后于行为测试(通常重测差异低于1 dB)。本文提出多解码器方法,从脑电信号中预测语音接收阈值(SRT),实现对无法完成行为测试人群(如意识障碍患者或助听器调试期间)的客观评估。该方法聚合数百个解码器的输出,每个解码器基于不同的语音特征和脑电预处理方案训练,以量化神经对语音的追踪(NT)。利用39名受试者(18-24岁)的数据,每人记录29分钟脑电,聆听六种信噪比下的语音及一个安静故事。将每位受试者的NT值整合为高维特征向量,使用支持向量回归模型预测其SRT。结果显示,预测值与行为测试结果显著相关(r = 0.647, p < 0.001;NRMSE = 0.19),所有差异均小于1 dB。SHAP分析表明,theta/delta频段和早期滞后具有稍大影响。使用预训练的跨被试解码器可将所需脑电采集时间缩短至15分钟(3分钟故事 + 12分钟六种信噪比条件),且不损失精度。
原文摘要 · Abstract (English)
Objective: EEG-based methods can predict speech intelligibility, but their accuracy and robustness lag behind behavioral tests, which typically show test-retest differences under 1 dB. We introduce the multi-decoder method to predict speech reception thresholds (SRTs) from EEG recordings, enabling objective assessment for populations unable to perform behavioral tests; such as those with disorders of consciousness or during hearing aid fitting. Approach: The method aggregates data from hundreds of decoders, each trained on different speech features and EEG preprocessing setups to quantify neural tracking (NT) of speech signals. Using data from 39 participants (ages 18-24), we recorded 29 minutes of EEG per person while they listened to speech at six signal-to-noise ratios and a quiet story. NT values were combined into a high-dimensional feature vector per subject, and a support vector regression model was trained to predict SRTs from these vectors. Main Result: Predictions correlated significantly with behavioral SRTs (r = 0.647, p < 0.001; NRMSE = 0.19), with all differences under 1 dB. SHAP analysis showed theta/delta bands and early lags had slightly greater influence. Using pretrained subject-independent decoders reduced required EEG data collection to 15 minutes (3 minutes of story, 12 minutes across six SNR conditions) without losing accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。