arXiv:2602.20932cs.LGcs.HC2026-02

用分层任务分析脑电如何编码抽象概念,发现越高阶越易解码。

Hierarchic-EEG2Text: Assessing EEG-To-Text Decoding across Hierarchical Abstraction Levels

  • 设计分层采样机制,让模型在不同抽象层级上测试分类能力
  • 在1610类物体、264人数据上验证,高层级类别解码准确率更高
  • 为脑电解码提供新视角,适合关注认知抽象的研究者

脑电图(EEG)记录大脑皮层神经元的平均电信号,从头皮测量。以往研究多针对有限类别、短暂呈现的图像或视频进行被动观看的分类任务,但受信噪比低影响,细粒度分类仍具挑战;而高层次抽象表征可能更稳定。本文探究EEG是否能在多层次抽象中捕捉物体表征,提出一种基于情节的评估方法——在多个相关但不同的分类任务(情节)中测试机器学习模型表现。不同于以往固定或随机采样等量类别的方法,本研究利用WordNet构建具有不同层级深度的可变类别情节。我们建立了迄今最大的脑电领域情节框架,基于PEERS数据集,包含931538个EEG样本、1610个物体标签,来自264名参与者在受控认知任务下的数据,可用于研究感知、决策与绩效监控的神经动态。通过对比多种学习方法与模型架构,发现当分类类别位于更高层次时,模型性能普遍提升,表明对抽象程度敏感。本工作强调了抽象深度是脑电解码中被忽视的关键维度,为未来研究指明方向。

原文摘要 · Abstract (English)

An electroencephalogram (EEG) records the spatially averaged electrical activity of neurons in the brain, measured from the human scalp. Prior studies have explored EEG-based classification of objects or concepts, often for passive viewing of briefly presented image or video stimuli, with limited classes. Because EEG exhibits a low signal-to-noise ratio, recognizing fine-grained representations across a large number of classes remains challenging; however, abstract-level object representations may exist. In this work, we investigate whether EEG captures object representations across multiple hierarchical levels, and propose episodic analysis, in which a Machine Learning (ML) model is evaluated across various, yet related, classification tasks (episodes). Unlike prior episodic EEG studies that rely on fixed or randomly sampled classes of equal cardinality, we adopt hierarchy-aware episode sampling using WordNet to generate episodes with variable classes of diverse hierarchy. We also present the largest episodic framework in the EEG domain for detecting observed text from EEG signals in the PEERS dataset, comprising $931538$ EEG samples under $1610$ object labels, acquired from $264$ human participants (subjects) performing controlled cognitive tasks, enabling the study of neural dynamics underlying perception, decision-making, and performance monitoring. We examine how the semantic abstraction level affects classification performance across multiple learning techniques and architectures, providing a comprehensive analysis. The models tend to improve performance when the classification categories are drawn from higher levels of the hierarchy, suggesting sensitivity to abstraction. Our work highlights abstraction depth as an underexplored dimension of EEG decoding and motivates future research in this direction.

脑电解码抽象表征层次分析机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。