用时空频三维度标记法,让脑电数据更准地翻译成脑磁图。
MEL: Coordinate-Preserving EEG Tokenization for fMRI Translation

- 将脑电信号按时间滞后、通道位置、频率带分块为神经状态令牌
- 在多个数据集上超越现有最强基线模型,提升翻译精度
- 适合做脑信号跨模态分析的研究者和临床神经监测应用
将脑电图(EEG)翻译为功能磁共振成像(fMRI)对医学神经影像、临床脑状态监测及多模态神经解码具有重要意义,旨在从快速且易获取的电生理记录中推断出空间分布的血流动力学活动。现有研究多聚焦于强化解码器,但受限于表征-接口不匹配:fMRI响应延迟、时间整合且空间分散,而通用的脑电编码常混淆时间滞后、通道身份与频段结构。本文提出多频带脑电隐状态标记化(MEL),一种保持坐标一致性的脑电表征框架,将每个目标fMRI响应锚定至其先前的脑电历史,并组织为滞后-通道-频率神经状态令牌。通过显式捕捉血流动力学延迟与谱-空间动态,MEL使fMRI相关的脑电表征与容量可控的读出模块对齐,无需完全依赖模型规模扩大。在VU EEG-fMRI基准数据集和外部Oddball数据集上的实验表明,MEL在预测性能上优于强基线NeuroBOLT模型。消融实验进一步表明,性能提升源于结构化脑电表征,而非信息泄露、捷径统计或解码器容量增加。
原文摘要 · Abstract (English)
Translating electroencephalography (EEG) into functional magnetic resonance imaging (fMRI) is important for medical neuroimaging, clinical brain-state monitoring, and multimodal neural decoding, because it aims to infer spatially organized hemodynamic activity from fast and accessible electrophysiological recordings. Existing EEG-to-fMRI studies mainly pursue stronger decoders, but the problem is also constrained by a representation-interface mismatch: fMRI responses are delayed, temporally integrated, and spatially distributed, whereas generic EEG encodings often entangle temporal lag, channel identity, and frequency-band structure. We propose Multi-band EEG Latent-state Tokenization (MEL), a coordinate-preserving EEG representation framework that anchors each target fMRI response to its preceding EEG history and organizes it into lag-channel-frequency neural-state tokens. By explicitly capturing hemodynamic latency and spectral-spatial dynamics, MEL aligns fMRI-pertinent EEG representations with capacity-controlled readouts without depending entirely on model scaling. Experiments on VU EEG-fMRI benchmarks and external Oddball data show that MEL improves prediction over strong NeuroBOLT baselines. Ablations and controls further indicate that the gains come from structured EEG representation rather than leakage, shortcut statistics, or decoder capacity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。