构建开放框架,测试脑电癫痫检测模型在真实场景下的鲁棒性
RobustSeiz: An Open-Source Framework for Benchmarking the Robustness of EEG Seizure Detection Models

- 统一四大公开脑电数据集格式,支持标准化压力测试
- 覆盖环境、噪声和对抗扰动,评估检测灵敏度与发作定位精度
- 提供可复现的部署前鲁棒性评测方案,适合临床研究者使用
尽管在保留的脑电(EEG)数据上表现良好,癫痫检测模型在真实采集中的变异、伪影和对抗输入下可能失效。我们提出RobustSeiz,一个开源、模型无关的框架,提供标准化、可复现的协议,在部署前对癫痫检测模型进行受控、临床相关的分布偏移压力测试。我们将四个公开的头皮脑电数据集(CHB-MIT、TUSZ、Siena、SeizeIT1)统一为BIDS-EEG结构,并在独立受试者分割上评估检测器性能。系统地施加环境、噪声和对抗变换,覆盖预定义超参数网格。每次实验报告样本级和事件级的敏感性、精确率、F1值、每24小时假阳性数、发作起始时间误差(提前/延迟),以及蒙特卡洛丢弃预测一致性。RobustSeiz包含容器化GPU流水线、实验注册表及全量评估与研究子集模式。我们以现代检测器在TUSZ数据集上完成全部扰动网格测试;白噪声分析显示扰动强度变化显著影响检测质量、发作时间定位及预测一致性。该框架为评估癫痫检测模型在真实临床压力下的鲁棒性提供了共享基准,拓展了部署前评估的维度。
原文摘要 · Abstract (English)
Despite strong performance on held-out electroencephalography (EEG) data, seizure detectors may fail under real-world acquisition variability, artifacts, and adversarial inputs. We introduce RobustSeiz, an open-source, model-agnostic framework that provides a standardized, reproducible protocol for stress-testing and comparing seizure detectors under controlled, clinically motivated distribution shifts before deployment. We standardize four public scalp-EEG corpora (CHB-MIT, TUSZ, Siena, and SeizeIT1) into BIDS-EEG trees and evaluate subject-independent detectors on held-out splits. Environment, noise, and adversarial transforms are swept over predefined hyperparameter grids. Each run reports sample- and event-level sensitivity, precision, F1, false positives per 24 h, Lead and Lag onset timing, and Monte Carlo dropout predictive agreement. RobustSeiz includes a Dockerized GPU pipeline, experiment registry, and full-evaluation and research-subset modes. We demonstrate the framework with a contemporary seizure detector on TUSZ across the complete implemented shift grid; an AWGN analysis illustrates how perturbation severity changes detection quality, onset timing, and predictive agreement. RobustSeiz provides a shared benchmarking standard for evaluating seizure-detector robustness under realistic clinical stressors, extending pre-deployment assessment beyond clean-data accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。