arXiv:2409.12520eess.AScs.SD2024-09被引 2

用脑电图选通道,让助听设备更省成本、更精准提升语音清晰度。

Geometry-Constrained EEG Channel Selection for Brain-Assisted Speech Enhancement

  • 基于脑电几何约束,自动筛选对语音增强有用的电极通道。
  • 新模型在公开数据集上性能优于现有方法,且减少通道使用量。
  • 适合开发可穿戴助听设备的研究者或工程师参考。

脑辅助语音增强(BASE)旨在利用脑电图(EEG)信号作为辅助模态,在复杂的多人对话场景中提取目标说话人语音,因为听众的听觉注意力可从脑电信号中解码。这为将EEG电极集成到助听设备中以提升听力障碍者的语音可懂度提供了可能,近期提出的BASEN模型已验证了这一点。然而,多通道EEG信号高度相关,部分通道甚至与听觉无关,盲目使用所有通道会导致高昂的经济和计算成本。为此,本文提出一种几何约束的EEG通道选择方法。设计了一种新的加权多膨胀时间卷积网络(WD-TCN)作为替代BASEN中Conv-TasNet的主干网络。给定由电极布局定义的可行通道集合,进一步提出几何约束卷积正则化选择(GC-ConvRS)模块,用于在几何约束下寻找具有信息量的EEG子集。在公开数据集上的实验表明,所提WD-TCN优于BASEN;GC-ConvRS可在满足几何约束的前提下进一步优化有效通道子集,实现性能与集成成本之间的更好平衡。

原文摘要 · Abstract (English)

Brain-assisted speech enhancement (BASE) aims to extract the target speaker in complex multi-talker scenarios using electroencephalogram (EEG) signals as an assistive modality, as the auditory attention of the listener can be decoded from electroneurographic signals of the brain. This facilitates a potential integration of EEG electrodes with listening devices to improve the speech intelligibility of hearing-impaired listeners, which was shown by the recently-proposed BASEN model. As in general the multichannel EEG signals are highly correlated and some are even irrelevant to listening, blindly incorporating all EEG channels would lead to a high economic and computational cost. In this work, we therefore propose a geometry-constrained EEG channel selection approach for BASE. We design a new weighted multi-dilation temporal convolutional network (WDTCN) as the backbone to replace the Conv-TasNet in BASEN. Given a raw channel set that is defined by the electrode geometry for feasible integration, we then propose a geometry-constrained convolutional regularization selection (GC-ConvRS) module for WD-TCN to find an informative EEG subset. Experimental results on a public dataset show the superiority of the proposed WD-TCN over BASEN. The GC-ConvRS can further refine the useful EEG subset subject to the geometry constraint, resulting in a better trade-off between performance and integration cost.

脑机接口语音增强通道选择EEG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。