用脑电图预测学习熟悉度,揭示关键脑波信号并建立真实评估基准
Automating Learner Assessment: Benchmarking Machine Learning and Deep Learning Models for EEG-Based Familiarity Prediction

- 对比15种机器学习模型,用脑电频谱特征预测认知熟悉度
- 严格独立验证下最高准确率0.6038,远低于传统方法的0.9853
- 发现前额和时间区的伽马与贝塔波是关键生物标志物
学习效果的客观评估仍是教育领域的根本挑战。脑电图(EEG)可无创直接观测知识获取的神经相关性,包括认知熟悉度。本研究在两个认知领域(人脸事实知识与数学公式概念知识)中,对十五种机器学习(ML)与深度学习(DL)模型进行基于EEG的熟悉度预测基准测试。使用23名受试者的连续EEG数据,提取六个频段的功率谱密度(Power Spectral Density)特征。结果显示,标准分层交叉验证因相邻时段的数据泄漏导致性能虚高(卷积神经网络最高达0.9853的F1分数),而采用严格的试验独立验证(组K折交叉验证)后,峰值性能降至0.6038(仍显著高于25%随机水平)。这凸显了试验独立验证对避免模型泛化能力过度估计的关键作用。此外,特征重要性与SHAP分析表明,前额与颞区的伽马与贝塔振荡是最关键的生物标志物。该研究为教育技术中的脑电认知监测建立了现实基准。
原文摘要 · Abstract (English)
Objective assessment of learning remains a fundamental challenge in education. Electroencephalography (EEG) provides a direct, non-invasive window into the neural correlates of knowledge acquisition, including cognitive familiarity. This study benchmarks fifteen machine learning (ML) and deep learning (DL) models for EEG-based familiarity prediction across two cognitive domains: faces (factual knowledge) and mathematical equations (conceptual knowledge). Using continuous EEG data from 23 participants, we extract spectral features (Power Spectral Density) across six frequency bands. We show that while standard stratified cross-validation yields artificially high classification performance (up to 0.9853 F1-score using CNN) due to temporal leakage across neighboring epochs, a rigorous trial-independent validation (Group K-Fold) drops the peak performance to 0.6038 F1-score (using CNN), which is still statistically significant above the 25% chance level. This highlights the critical necessity of trial-independent evaluation to avoid overestimating model generalizability. Furthermore, feature importance and SHAP analysis reveal that temporal and frontal Gamma and Beta oscillations are the most critical biomarkers for familiarity. This work establishes a realistic benchmark for EEG-based cognitive monitoring in educational technologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。