arXiv:2602.04769cs.LG2026-02

将多通道脑电图转为图像,用大模型高效准确检测癫痫发作。

NeuroCanvas: VLLM-Powered Robust Seizure Detection by Reformulating Multichannel EEG as Image

  • 把脑电信号按重要性选通道并转成视觉图块,降低复杂度。
  • 在多个数据集上提升20%检测准确率,推理延迟减少88%。
  • 适合需要实时、低资源癫痫监测的临床场景。

从脑电图(EEG)中准确及时地检测癫痫发作对临床干预至关重要,但长时间记录的手动分析耗时费力。近期将脑电信号编码进大语言模型(LLM)的方法展现出跨患者处理神经信号的潜力,但仍面临两大挑战:(1) 多通道异质性,即癫痫相关信号在不同脑电通道间差异显著;(2) 计算效率低下,因需将信号编码为大量标记进行预测。为此,我们提出新型NeuroCanvas框架。该框架包含两个模块:(i) 熵引导通道选择器(ECS)筛选出与癫痫相关的输入通道;(ii) 神经信号画布(CNS)将选定的多通道异质性脑电信号转换为结构化视觉表示。ECS模块缓解了通道异质性问题,而CNS使用紧凑的视觉标记表示信号,显著提升计算效率。我们在多个癫痫检测数据集上评估NeuroCanvas,结果显示F1分数提升20%,推理延迟降低88%。这些结果表明,NeuroCanvas是一种可扩展、高效的实时且资源节约型癫痫检测方案,适用于临床实践。

原文摘要 · Abstract (English)

Accurate and timely seizure detection from Electroencephalography (EEG) is critical for clinical intervention, yet manual review of long-term recordings is labor-intensive. Recent efforts to encode EEG signals into large language models (LLMs) show promise in handling neural signals across diverse patients, but two significant challenges remain: (1) multi-channel heterogeneity, as seizure-relevant information varies substantially across EEG channels, and (2) computing inefficiency, as the EEG signals need to be encoded into a massive number of tokens for the prediction. To address these issues, we draw the EEG signal and propose the novel NeuroCanvas framework. Specifically, NeuroCanvas consists of two modules: (i) The Entropy-guided Channel Selector (ECS) selects the seizure-relevant channels input to LLM and (ii) the following Canvas of Neuron Signal (CNS) converts selected multi-channel heterogeneous EEG signals into structured visual representations. The ECS module alleviates the multi-channel heterogeneity issue, and the CNS uses compact visual tokens to represent the EEG signals that improve the computing efficiency. We evaluate NeuroCanvas across multiple seizure detection datasets, demonstrating a significant improvement of 20% in F1 score and reductions of 88% in inference latency. These results highlight NeuroCanvas as a scalable and effective solution for real-time and resource-efficient seizure detection in clinical practice.

癫痫检测脑电图大模型视觉化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。