arXiv:2508.05164cs.LG2025-08NeurIPS被引 3

用脉冲神经网络实现低功耗高精度听觉注意力检测

S$^2$M-Former: Spiking Symmetric Mixing Branchformer for Brain Auditory Attention Detection

  • 设计双分支对称脉冲架构,融合空间与频域特征增强互补学习
  • 参数减少14.7倍,能耗降低5.8倍,性能达最新水平
  • 适合开发节能型脑机接口助听设备的研发人员

听觉注意力检测(AAD)旨在从脑电图(EEG)信号中解码复杂听觉环境中的注意力焦点,对开发神经控制助听设备至关重要。尽管已有进展,基于EEG的AAD仍受限于缺乏能兼顾互补特征利用与能效的协同框架。本文提出S²M-Former,一种新型脉冲对称混合架构:首先,构建并行的空间与频率双分支结构,采用镜像模块设计与生物合理性的令牌-通道混合器,强化跨分支互补学习;其次,引入轻量级一维令牌序列替代传统三维操作,使参数量减少14.7倍。受大脑启发的脉冲架构进一步降低功耗,相比最新人工神经网络方法能耗降低5.8倍,同时在参数效率和性能上超越现有脉冲神经网络基线。在三个AAD基准数据集(KUL、DTU、AV-GC-AAD)的三种设置(同试验、跨试验、跨被试)下综合实验表明,S²M-Former达到接近顶尖的解码准确率,是适用于低功耗、高性能AAD任务的有力方案。代码已开源。

原文摘要 · Abstract (English)

Auditory attention detection (AAD) aims to decode listeners' focus in complex auditory environments from electroencephalography (EEG) recordings, which is crucial for developing neuro-steered hearing devices. Despite recent advancements, EEG-based AAD remains hindered by the absence of synergistic frameworks that can fully leverage complementary EEG features under energy-efficiency constraints. We propose S$^2$M-Former, a novel spiking symmetric mixing framework to address this limitation through two key innovations: i) Presenting a spike-driven symmetric architecture composed of parallel spatial and frequency branches with mirrored modular design, leveraging biologically plausible token-channel mixers to enhance complementary learning across branches; ii) Introducing lightweight 1D token sequences to replace conventional 3D operations, reducing parameters by 14.7$\times$. The brain-inspired spiking architecture further reduces power consumption, achieving a 5.8$\times$ energy reduction compared to recent ANN methods, while also surpassing existing SNN baselines in terms of parameter efficiency and performance. Comprehensive experiments on three AAD benchmarks (KUL, DTU and AV-GC-AAD) across three settings (within-trial, cross-trial and cross-subject) demonstrate that S$^2$M-Former achieves comparable state-of-the-art (SOTA) decoding accuracy, making it a promising low-power, high-performance solution for AAD tasks. Code is available at https://github.com/JackieWang9811/S2M-Former.

脑机接口脉冲神经网络听觉注意低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。