arXiv:2410.13059cs.SDeess.AS2024-10被引 23

用端到端深度学习模型直接解码听觉注意力,提升跨被试泛化能力。

AADNet: An End-to-End Deep Learning Model for Auditory Attention Decoding

  • 将传统两阶段方法合并为端到端网络,直接从脑电数据解码注意力焦点。
  • 跨被试分类准确率从56.1%提升至82.7%,窗口长度1~40秒内表现稳定。
  • 适合开发神经控制助听器与临床注意力评估系统,实用性强。

听觉注意力解码(AAD)旨在通过脑电信号(EEG)识别多人对话环境中的关注语音。过去十年间,该领域持续发展,主要应用于神经控制助听设备。传统方法依赖于关注语音包络在神经活动中的同步增强,采用两步流程:先预测关注语音的包络表示,再通过相关性匹配识别目标语音。本文提出新型端到端神经网络 AADNet,将两阶段过程整合为直接解码。在两个不同数据集上对比线性信号重建、典型相关分析及非线性重建方法,结果显示,无论针对特定被试还是跨被试模型,AADNet 均显著提升性能。尤其在跨被试场景中,分类准确率从56.1%提升至82.7%,分析窗口长度为1至40秒时表现优异,显示更强泛化能力。这些结果表明深度学习可推动AAD技术发展,对未来助听器、辅助设备及临床评估具有重要意义。

原文摘要 · Abstract (English)

Auditory attention decoding (AAD) is the process of identifying the attended speech in a multi-talker environment using brain signals, typically recorded through electroencephalography (EEG). Over the past decade, AAD has undergone continuous development, driven by its promising application in neuro-steered hearing devices. Most AAD algorithms are relying on the increase in neural entrainment to the envelope of attended speech, as compared to unattended speech, typically using a two-step approach. First, the algorithm predicts representations of the attended speech signal envelopes; second, it identifies the attended speech by finding the highest correlation between the predictions and the representations of the actual speech signals. In this study, we proposed a novel end-to-end neural network architecture, named AADNet, which combines these two stages into a direct approach to address the AAD problem. We compare the proposed network against the traditional approaches, including linear stimulus reconstruction, canonical correlation analysis, and an alternative non-linear stimulus reconstruction using two different datasets. AADNet shows a significant performance improvement for both subject-specific and subject-independent models. Notably, the average subject-independent classification accuracies from 56.1 % to 82.7 % with analysis window lengths ranging from 1 to 40 seconds, respectively, show a significantly improved ability to generalize to data from unseen subjects. These results highlight the potential of deep learning models for advancing AAD, with promising implications for future hearing aids, assistive devices, and clinical assessments.

听觉注意脑机接口深度学习助听器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。