首个将脑电图直接转为临床报告的通用模型,让机器读懂大脑信号。
NeuroNarrator: A Generalist EEG-to-Text Foundation Model for Clinical Interpretation via Spectro-Spatial Grounding and Temporal State-Space Reasoning
- 通过频谱-空间对齐与状态空间推理,打通脑电信号与语言描述的桥梁。
- 在16万段脑电数据上训练,可零样本生成符合临床规范的描述。
- 适合神经科医生、研究者用于自动报告生成和信号解释辅助。
脑电图(EEG)以高时间分辨率提供非侵入式神经动态观测,在临床神经科学中至关重要。然而现有计算方法多局限于特定任务分类或粗粒度模式识别,难以支持有意义的临床解读。为此,我们提出NeuroNarrator,首个面向临床解释的通用型脑电图到文本的基础模型。核心创新在于构建了首个大规模标准化资源NeuroCorpus-160K,包含超过16万段脑电片段及其结构化、临床导向的自然语言描述。模型首先通过对比学习对齐时间波形与空间拓扑图,建立频谱-空间锚定表征;在此基础上,采用受状态空间启发的架构,融合历史时序与频谱上下文,引导大语言模型生成连贯临床叙述。该方法实现了连续信号动态与离散语言表达之间的原则性衔接,支持可解释的叙事生成,助力专家解读并融入临床报告流程。跨多样基准与零样本迁移任务的评估表明,NeuroNarrator能有效整合时序、频谱与空间动态,为时间-频率感知的开放式临床解释提供基础框架。
原文摘要 · Abstract (English)
Electroencephalography (EEG) provides a non-invasive window into neural dynamics at high temporal resolution and plays a pivotal role in clinical neuroscience research. Despite this potential, prevailing computational approaches to EEG analysis remain largely confined to task-specific classification objectives or coarse-grained pattern recognition, offering limited support for clinically meaningful interpretation. To address these limitations, we introduce NeuroNarrator, the first generalist EEG-to-text foundation model designed to translate electrophysiological segments into precise clinical narratives. A cornerstone of this framework is the curation of NeuroCorpus-160K, the first harmonized large-scale resource pairing over 160,000 EEG segments with structured, clinically grounded natural-language descriptions. Our architecture first aligns temporal EEG waveforms with spatial topographic maps via a rigorous contrastive objective, establishing spectro-spatially grounded representations. Building on this grounding, we condition a Large Language Model through a state-space-inspired formulation that integrates historical temporal and spectral context to support coherent clinical narrative generation. This approach establishes a principled bridge between continuous signal dynamics and discrete clinical language, enabling interpretable narrative generation that facilitates expert interpretation and supports clinical reporting workflows. Extensive evaluations across diverse benchmarks and zero-shot transfer tasks highlight NeuroNarrator's capacity to integrate temporal, spectral, and spatial dynamics, positioning it as a foundational framework for time-frequency-aware, open-ended clinical interpretation of electrophysiological data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。