用心电图特征预测脑负荷,实现可穿戴设备上的实时认知监测。
Cross-Modal Computational Model of Brain-Heart Interactions via HRV and EEG Feature
- 通过心电图提取心率变异性与捕捉22特征,映射到脑电指标。
- 合成数据增强模型在数据稀疏时的鲁棒性,准确率提升显著。
- 适合老年人、临床人群及人机交互场景的轻量级可解释系统。
脑电图(EEG)是量化心理负荷的金标准,但因其复杂性和非便携性而受限。心电图(ECG)信号可在头戴式可穿戴设备上采集,为认知状态监测提供了新途径。本研究探讨了ECG信号是否能一致反映心理负荷,并作为EEG认知指标的替代。基于OpenNeuro公开多模态数据集(包含工作记忆与听觉任务下的EEG与ECG),从ECG中提取HRV与Catch22特征,从EEG中提取频段功率与Catch22特征。采用基于XGBoost的跨模态回归框架,将ECG衍生的HRV表示映射至EEG衍生的认知特征。为应对数据稀疏与建模脑-心交互的挑战,引入PSV-SDG生成条件化合成的HRV时间序列。该方法结合多模态学习、信号处理与合成数据生成,有效提升了仅依赖ECG特征推断认知负荷的能力。结果支持构建轻量、可解释的机器学习模型,适用于非实验室环境中的可穿戴生物传感器。合成HRV增强了模型在数据稀缺情况下的鲁棒性。本研究为面向老龄化与临床人群的心理健康、教育与人机交互领域,提供低成本、可解释、实时的认知监测系统基础。
原文摘要 · Abstract (English)
The electroencephalogram (EEG) has been the gold standard for quantifying mental workload; however, due to its complexity and non-portability, it can be constraining. ECG signals, which are feasible on wearable equipment pieces such as headbands, present a promising method for cognitive state monitoring. This research explores whether electrocardiogram (ECG) signals are able to indicate mental workload consistently and act as surrogates for EEG-based cognitive indicators. This study investigates whether ECG-derived features can serve as surrogate indicators of cognitive load, a concept traditionally quantified using EEG. Using a publicly available multimodal dataset (OpenNeuro) of EEG and ECG recorded during working-memory and listening tasks, features of HRV and Catch22 descriptors are extracted from ECG, and spectral band-power with Catch22 features from EEG. A cross-modal regression framework based on XGBoost was trained to map ECG-derived HRV representations to EEG-derived cognitive features. In order to address data sparsity and model brain-heart interactions, we integrated the PSV-SDG to produce EEG-conditioned synthetic HRV time series.This addresses the challenge of inferring cognitive load solely from ECG-derived features using a combination of multimodal learning, signal processing, and synthetic data generation. These outcomes form a basis for light, interpretable machine learning models that are implemented through wearable biosensors in non-lab environments. Synthetic HRV inclusion enhances robustness, particularly in sparse data situations. Overall, this work is an initiation for building low-cost, explainable, and real-time cognitive monitoring systems for mental health, education, and human-computer interaction, with a focus on ageing and clinical populations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。