用扩散模型生成脑电信号,让模型学会全局特征。
EEGDM: Learning EEG Representation with Latent Diffusion Model
- 用扩散模型逐步去噪生成脑电,替代传统掩码重建。
- 能高质量还原脑电信号,且在下游任务表现优异。
- 适合想学脑电全局结构的科研人员或工程师。
近期自监督学习在脑电信号表征方面主要依赖掩码重建,即模型训练以恢复随机掩码的信号片段。尽管有效建模局部依赖,但该目标未能强制模型捕捉神经活动所必需的全局生成约束。为此,我们提出EEGDM,一种新颖的自监督框架,利用潜在扩散模型以生成脑电信号作为训练目标。与掩码重建不同,基于扩散的生成从噪声逐步去噪至真实信号,迫使模型学习整体时序模式和跨通道关系。具体而言,EEGDM包含一个脑电编码器,将原始信号及其通道增强信息压缩为紧凑表示,作为条件信息引导扩散去噪过程,从而通过生成目标联合优化编码器与扩散模型。该设计赋予EEGDM紧凑的潜在空间,不仅提供对生成过程的充分控制,还可用于下游任务。实验表明,EEGDM(1)可高质量重建脑电信号,(2)学习到鲁棒的表征,(3)在多种下游任务中达到有竞争力的表现,探索了自监督脑电表征学习的新方向。
原文摘要 · Abstract (English)
Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, the training objective of masked reconstruction does not compel the model to capture global generative constraints essential for characterizing neural activity. To address this limitation, we propose EEGDM, a novel self-supervised framework that leverages latent diffusion models to generate EEG signals as an objective. Unlike masked reconstruction, diffusion-based generation progressively denoises signals from noise to realism, compelling the model to capture holistic temporal patterns and cross-channel relationships. Specifically, EEGDM incorporates an EEG encoder that distills raw signals and their channel augmentations into a compact representation, which serves as conditional information to guide the diffusion denoising process, thereby enabling the encoder and diffusion model to be jointly optimized through the generative objective. This design endows EEGDM with a compact latent space, which not only offers ample control over the generative process but also can be leveraged for downstream tasks. Experimental results show that EEGDM (1) reconstructs high-quality EEG signals, (2) learns robust representations, and (3) achieves competitive performance across diverse downstream tasks, thus exploring a new direction for self-supervised EEG representation learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。