提出双轴注意力模型,提升脑电图预测昏迷患者神经预后的准确性
Biaxialformer: Leveraging Channel Independence and Inter-Channel Correlations in EEG Signal Decoding for Predicting Neurological Outcomes
- 分两阶段建模脑电信号的时序与空间特征,兼顾通道独立性与跨通道相关性
- 在五家医院数据上实现AUC 0.7688、AUPRC 0.8643、F1 0.6518的跨院泛化性能
- 引入双极导联信号和可变感受野分词模块,增强对脑区交互与局部细节的捕捉
精准解码脑电信号需全面建模单通道内的时序动态与多通道间的空间依赖。尽管基于Transformer的通道独立(CI)模型在时间序列任务中表现优异,但常忽略多变量脑电信号中至关重要的跨通道相关性,导致信息衰减与预测精度下降,尤其在神经预后预测等复杂任务中。为此,我们提出Biaxialformer,一种精心设计的双阶段注意力框架。该模型分别独立捕获序列特异性(时序)与通道特异性(空间)信息,促进通道间协同增强而不牺牲通道独立性。通过联合学习位置编码,模型保留了脑电数据中的时序与空间关系,缓解传统CI模型中跨通道相关性遗忘问题。此外,采用具有可变感受野的分词模块,在提取细粒度局部特征与广义时序依赖之间取得平衡。为强化空间特征提取,引入双极脑电信号以捕捉半球间脑区交互,这一关键但常被忽视的机制。本研究拓展了Transformer在昏迷患者神经预后预测中的应用。基于来自五家医院的多中心I-CARE数据集,Biaxialformer在跨医院场景下验证了鲁棒性与泛化能力,平均AUC为0.7688,AUPRC为0.8643,F1为0.6518。
原文摘要 · Abstract (English)
Accurate decoding of EEG signals requires comprehensive modeling of both temporal dynamics within individual channels and spatial dependencies across channels. While Transformer-based models utilizing channel-independence (CI) strategies have demonstrated strong performance in various time series tasks, they often overlook the inter-channel correlations that are critical in multivariate EEG signals. This omission can lead to information degradation and reduced prediction accuracy, particularly in complex tasks such as neurological outcome prediction. To address these challenges, we propose Biaxialformer, characterized by a meticulously engineered two-stage attention-based framework. This model independently captures both sequence-specific (temporal) and channel-specific (spatial) EEG information, promoting synergy and mutual reinforcement across channels without sacrificing CI. By employing joint learning of positional encodings, Biaxialformer preserves both temporal and spatial relationships in EEG data, mitigating the interchannel correlation forgetting problem common in traditional CI models. Additionally, a tokenization module with variable receptive fields balance the extraction of fine-grained, localized features and broader temporal dependencies. To enhance spatial feature extraction, we leverage bipolar EEG signals, which capture inter-hemispheric brain interactions, a critical but often overlooked aspect in EEG analysis. Our study broadens the use of Transformer-based models by addressing the challenge of predicting neurological outcomes in comatose patients. Using the multicenter I-CARE data from five hospitals, we validate the robustness and generalizability of Biaxialformer with an average AUC 0.7688, AUPRC 0.8643, and F1 0.6518 in a cross-hospital scenario.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。