解决脑电图预测中数据泄露问题,提升模型可靠性
Preventing Data Leakage in EEG-Based Survival Prediction: A Two-Stage Embedding and Transformer Framework
- 分两阶段处理:先用CNN提取嵌入,再用Transformer聚合
- 严格隔离患者数据,使测试集敏感度保持在85%以上
- 适合重症监护、脑损伤预后研究的临床模型开发
深度学习在心脏骤停后昏迷患者脑电图(EEG)生存预测中表现优异,但其可靠性常因隐蔽的数据泄露而受损。当长段EEG被切分为短窗并在多阶段训练中重复使用时,模型可能隐式编码标签信息,导致验证性能虚高、泛化能力差。本研究揭示了多阶段EEG建模流程中被忽视的数据泄露形式。实验表明,违反患者级数据分离会显著提高验证指标,但在独立测试集上性能大幅下降。为此,我们提出一种抗泄露的两阶段框架:第一阶段采用带ArcFace目标的卷积神经网络将短窗转换为嵌入表示;第二阶段通过Transformer聚合嵌入,严格隔离训练队列以消除泄露路径。在大规模心脏骤停后患者EEG数据集上的实验显示,该框架在临床相关约束下实现稳定且可泛化的性能,尤其在严格特异性阈值下保持高敏感度(>85%)。结果强调了严格数据划分的重要性,并为可靠的EEG生存预测提供了实用方案。
原文摘要 · Abstract (English)
Deep learning models have shown promise in EEG-based outcome prediction for comatose patients after cardiac arrest, but their reliability is often compromised by subtle forms of data leakage. In particular, when long EEG recordings are segmented into short windows and reused across multiple training stages, models may implicitly encode and propagate label information, leading to overly optimistic validation performance and poor generalization. In this study, we identify a previously overlooked form of data leakage in multi-stage EEG modeling pipelines. We demonstrate that violating strict patient-level separation can significantly inflate validation metrics while causing substantial degradation on independent test data. To address this issue, we propose a leakage-aware two-stage framework. In the first stage, short EEG segments are transformed into embedding representations using a convolutional neural network with an ArcFace objective. In the second stage, a Transformer-based model aggregates these embeddings to produce patient-level predictions, with strict isolation between training cohorts to eliminate leakage pathways. Experiments on a large-scale EEG dataset of post-cardiac-arrest patients show that the proposed framework achieves stable and generalizable performance under clinically relevant constraints, particularly in maintaining high sensitivity at stringent specificity thresholds. These results highlight the importance of rigorous data partitioning and provide a practical solution for reliable EEG-based outcome prediction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。