arXiv:2604.26379cs.CV2026-04

融合脑电与视频信息,实现小鼠癫痫发作高精度低误报检测

A Multimodal Pre-trained Network for Integrated EEG-Video Seizure Detection

论文配图:A Multimodal Pre-trained Network for Integrated EEG-Video Seizure Detection
图 1 · 摘自论文原文
  • 通过自监督脑电预训练与时空视频编码,融合多模态信号
  • 在随机会话划分下达到99.57%平衡准确率,每小时仅0.625个误报
  • 特别适合需要低误报率的癫痫药物筛选等预临床研究

可靠的小鼠癫痫发作检测对临床前研究至关重要,但同步视频-脑电图(EEG)的人工审阅耗时费力。基于视频的方法易受正常行为干扰,而基于脑电的方法则易受发作期运动伪影影响。本文提出EEGVFusion,一种结合自监督脑电表征学习、时空视频编码、最优传输对齐和双向交叉注意力的多模态框架,以整合神经与行为证据。我们还构建了一个专家标注的同步脑电-视频数据集,包含15只小鼠的93个实验会话。在随机会话划分下,EEGVFusion达到0.9957的平衡准确率,事件敏感性为1.0,事件误报率(Event FAR)仅为0.6250次/小时,表现优异且误报率极低。在保留小鼠110作为独立测试集的情况下,平衡准确率达0.9718,事件误报率从脑电单模态的2.7250次/小时降至0.4833次/小时,同时保持100%事件敏感性。针对性消融实验表明,脑电预训练和最优传输对齐有助于降低误报,同时维持高敏感性。

原文摘要 · Abstract (English)

Reliable seizure detection in mouse models is essential for preclinical epilepsy research, yet manual review of synchronized video-EEG recordings is labor-intensive and single-modality systems fail for complementary reasons: video-based methods are easily confounded by benign behaviors, whereas EEG-based methods are vulnerable to ictal motion artifacts. We present EEGVFusion, a multimodal framework that combines self-supervised EEG representation learning, spatio-temporal video encoding, optimal-transport alignment, and bidirectional cross-attention to integrate neural and behavioral evidence. We also curate an expert-annotated dataset of synchronized EEG and video recordings comprising 93 sessions from 15 mice for training and evaluation. In the random-session split, EEGVFusion achieved a Balanced Accuracy of 0.9957 with perfect event sensitivity and an Event FAR of 0.6250 FP/h, indicating strong seizure detection performance with a low false-alarm burden. In a single held-out-subject evaluation with Subject 110 reserved for testing, EEGVFusion achieved a Balanced Accuracy of 0.9718 and reduced Event FAR from 2.7250 FP/h for the EEG-only counterpart to 0.4833 FP/h while preserving perfect event sensitivity. Targeted ablations further showed that EEG pre-training and OT alignment help reduce false alarms while preserving event sensitivity.

癫痫检测多模态融合脑电图视频分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。