arXiv:2510.09095cs.LGcs.NE2025-10被引 9

用神经编码器将脑电数据转为离散标记,提升低资源场景下的信号解析效率

Neural Codecs as Biosignal Tokenizers

  • 借鉴神经编码器思想,将脑电信号转化为离散令牌表示
  • 在数千小时脑电数据上预训练,跨临床诊断、睡眠分析等任务表现优异
  • 适用于脑电与肌电等多种生物信号,尤其适合数据少的场景

脑电图(EEG)等神经生理记录为医疗健康、筛查诊断乃至沉浸式娱乐提供了便捷且微创的生理活动评估手段。然而,这些数据通常为高维、噪声大时序信号,需复杂预处理与手工特征提取才能挖掘有效信息。近期,基于大型预训练模型的表征学习技术在解码与解读生物信号方面受到关注。本文探讨了此类方法的挑战,并提出BioCodec——一种受神经编码器启发的表征学习框架,能以离散令牌形式捕捉信号的底层特征。该模型在数千小时脑电数据上预训练,可有效支持多种下游任务,涵盖临床诊断、睡眠生理分析、语音与运动意象解码,尤其在低资源条件下表现突出。此外,我们对代码本使用进行了定性分析,并估计了脑电连接性下的代码本嵌入空间相干性。值得注意的是,该方法同样适用于其他生物信号,如肌电(EMG)。整体而言,该方案提供了一种通用的生物信号标记化方法,在性能上可媲美当前最优模型。源代码与模型权重均已公开。

原文摘要 · Abstract (English)

Neurophysiological recordings such as electroencephalography (EEG) offer accessible and minimally invasive means of estimating physiological activity for applications in healthcare, diagnostic screening, and even immersive entertainment. However, these recordings yield high-dimensional, noisy time-series data that typically require extensive pre-processing and handcrafted feature extraction to reveal meaningful information. Recently, there has been a surge of interest in applying representation learning techniques from large pre-trained (foundation) models to effectively decode and interpret biosignals. We discuss the challenges posed for incorporating such methods and introduce BioCodec, an alternative representation learning framework inspired by neural codecs to capture low-level signal characteristics in the form of discrete tokens. Pre-trained on thousands of EEG hours, BioCodec shows efficacy across multiple downstream tasks, ranging from clinical diagnostic tasks and sleep physiology to decoding speech and motor imagery, particularly in low-resource settings. Additionally, we provide a qualitative analysis of codebook usage and estimate the spatial coherence of codebook embeddings from EEG connectivity. Notably, we also document the suitability of our method to other biosignal data, i.e., electromyographic (EMG) signals. Overall, the proposed approach provides a versatile solution for biosignal tokenization that performs competitively with state-of-the-art models. The source code and model checkpoints are shared.

生物信号神经编码器脑电图令牌化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。