DARNet通过时空构建与双注意力机制,提升听觉注意力检测精度。
DARNet: Dual Attention Refinement Network with Spatiotemporal Construction for Auditory Attention Detection
- 设计时空构造模块捕捉脑电空间分布特征
- 双注意力模块增强长程依赖建模能力,2秒时提升3.9%准确率
- 参数量减少91%,适合资源受限场景部署
在鸡尾酒会场景中,人类能精准聚焦特定说话者。听觉注意力检测(AAD)旨在通过分析脑电信号(如EEG)识别关注的说话人。现有方法忽视脑电信号的空间分布信息,且难以捕捉长程潜在依赖关系,制约了脑活动解码能力。为此,本文提出面向听觉注意力检测的双注意力精炼网络DARNet,包含时空构造模块、双注意力精炼模块和特征融合与分类模块。其中,时空构造模块通过捕捉脑电信号的空间分布特性,构建更具表达力的时空特征;双注意力精炼模块提取多尺度时间模式,强化对长程依赖的建模;特征融合与分类模块整合不同层次的时间模式与依赖关系,输出最终分类结果。实验表明,在DTU数据集上,相较于现有最优模型,DARNet在0.1秒、1秒和2秒窗口下的平均分类准确率分别提升5.9%、4.6%和3.9%。同时,模型参数量减少91%,显著降低计算开销。代码已开源:https://github.com/fchest/DARNet.git。
原文摘要 · Abstract (English)
At a cocktail party, humans exhibit an impressive ability to direct their attention. The auditory attention detection (AAD) approach seeks to identify the attended speaker by analyzing brain signals, such as EEG signals. However, current AAD algorithms overlook the spatial distribution information within EEG signals and lack the ability to capture long-range latent dependencies, limiting the model's ability to decode brain activity. To address these issues, this paper proposes a dual attention refinement network with spatiotemporal construction for AAD, named DARNet, which consists of the spatiotemporal construction module, dual attention refinement module, and feature fusion \& classifier module. Specifically, the spatiotemporal construction module aims to construct more expressive spatiotemporal feature representations, by capturing the spatial distribution characteristics of EEG signals. The dual attention refinement module aims to extract different levels of temporal patterns in EEG signals and enhance the model's ability to capture long-range latent dependencies. The feature fusion \& classifier module aims to aggregate temporal patterns and dependencies from different levels and obtain the final classification results. The experimental results indicate that compared to the state-of-the-art models, DARNet achieves an average classification accuracy improvement of 5.9\% for 0.1s, 4.6\% for 1s, and 3.9\% for 2s on the DTU dataset. While maintaining excellent classification performance, DARNet significantly reduces the number of required parameters. Compared to the state-of-the-art models, DARNet reduces the parameter count by 91\%. Code is available at: https://github.com/fchest/DARNet.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。