arXiv:2601.15097eess.SPcs.SD2026-01

用便携式EEG在真实对话中追踪注意力切换与持续关注,效果稳定可靠。

Neural Tracking of Sustained Attention, Attention Switching, and Natural Conversation in Audiovisual Environments using Mobile EEG

  • 采用便携式44电极+20cEEGrid EEG系统,模拟真实多说话人听觉场景
  • 脑电波响应差异显著,注意力分类准确率达55%-70%(高于随机)
  • 适用于真实世界动态音频视觉环境下的注意力研究与应用设计

日常交流具有动态性和多感官特征,常涉及注意力转移、重叠语音和视觉线索。然而,现有神经注意力追踪研究仍局限于高度控制的实验室环境,通常使用纯净音频刺激且要求受试者持续关注单一说话人。本研究通过24名听力正常参与者的实验,引入新型移动脑电图(EEG)数据集,采用44个头皮电极与20个cEEGrid电极,在包含三种条件的视听(AV)范式下进行:在双说话人环境中持续关注单一说话人、在两个说话人间切换注意力,以及与竞争性单说话人进行非脚本双人对话。分析方法包括时序响应函数(TRFs)建模、最优延迟分析、决策窗口范围为1.1至35秒的选择性注意力分类,以及对比视听对话与仅音频说话人条件下注意力的TRFs差异。结果显示,头皮EEG在不同条件下均能显著区分被关注与被忽略的语音,其注意相关P2峰值存在显著差异;注意力切换与持续关注的表现无显著差异,表明系统具备鲁棒性。最优延迟分析显示,对话条件下的峰值更窄,反映多说话人处理的额外复杂性。选择性注意力分类在头皮EEG上始终优于随机水平(准确率55%-70%),而cEEGrid数据相关性较低,提示需进一步优化方法。结果表明,移动EEG可有效追踪动态多感官环境中的选择性注意力,为未来视听范式设计及真实场景注意力监测提供指导。

原文摘要 · Abstract (English)

Everyday communication is dynamic and multisensory, often involving shifting attention, overlapping speech and visual cues. Yet, most neural attention tracking studies are still limited to highly controlled lab settings, using clean, often audio-only stimuli and requiring sustained attention to a single talker. This work addresses that gap by introducing a novel dataset from 24 normal-hearing participants. We used a mobile electroencephalography (EEG) system (44 scalp electrodes and 20 cEEGrid electrodes) in an audiovisual (AV) paradigm with three conditions: sustained attention to a single talker in a two-talker environment, attention switching between two talkers, and unscripted two-talker conversations with a competing single talker. Analysis included temporal response functions (TRFs) modeling, optimal lag analysis, selective attention classification with decision windows ranging from 1.1s to 35s, and comparisons of TRFs for attention to AV conversations versus side audio-only talkers. Key findings show significant differences in the attention-related P2-peak between attended and ignored speech across conditions for scalp EEG. No significant change in performance between switching and sustained attention suggests robustness for attention switches. Optimal lag analysis revealed narrower peak for conversation compared to single-talker AV stimuli, reflecting the additional complexity of multi-talker processing. Classification of selective attention was consistently above chance (55-70% accuracy) for scalp EEG, while cEEGrid data yielded lower correlations, highlighting the need for further methodological improvements. These results demonstrate that mobile EEG can reliably track selective attention in dynamic, multisensory listening scenarios and provide guidance for designing future AV paradigms and real-world attention tracking applications.

移动EEG注意力追踪多说话人视听融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。