arXiv:2605.01238cs.HCcs.CV2026-05

用传感器数据实时捕捉学习者专注度,提升自适应学习系统效果。

EduGage: Methods and Dataset for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning

论文配图:EduGage: Methods and Dataset for Sensor-Based Momentary Assessment of Engagement in Self-Guided Video Learning
图 1 · 摘自论文原文
  • 融合生理与动作信号,构建多模态学习专注度评估模型。
  • 跨参与者验证下平均误差仅0.81,准确率达83.75%。
  • 适合教育科技、人机交互研究者,推动个性化学习发展。

专注度关联注意力、情绪与认知维度,在在线视频学习中至关重要。本研究采用可穿戴与摄像头设备采集PPG、ECG、EDA、EEG、IMU、心率、体温及眼动数据,结合16名参与者在视频学习场景中的重复即时自我报告,构建并评估专注度估计系统。通过对比不同传感模态,分析多模态建模可行性。在跨参与者交叉验证中,模型实现0.81的平均绝对误差(MAE)、83.75%的within-1准确率、73.93%二分类准确率和68.45%二分类宏平均F1值,优于无传感器、统计、深度时序、基础模型及大语言模型基线。结果表明细粒度专注度估计可行但具噪声,实际系统应优先采用轻量级行为与生理信号组合。研究发布EduGage数据集,包含同步多模态信号、探针对齐的瞬时专注度标签、视频元数据、测验题与学习材料,支持可复现的自导式学习专注度建模研究。

原文摘要 · Abstract (English)

Engagement, which links to attentional, emotional, and cognitive dimensions, plays an important role in learning. In online and video-based learning environments, learners often need to regulate their own interactions with instructional materials. Measuring and reflecting on engagement can therefore support both learners and adaptive learning systems. In this study, we use wearable and camera-based sensing devices to collect physiological and motion signals, including PPG, ECG, EDA, EEG, IMU, heart rate, temperature, and eye-tracking data, to estimate learner engagement. We conducted a user study with 16 participants in a video-based learning scenario, where participants completed learning tasks and provided repeated in-situ self-reports of engagement through brief probes. We develop and evaluate a system for engagement estimation, compare different sensing modalities, and further analyze the feasibility and effectiveness of multimodal modeling for characterizing learner engagement. Across participant-based cross-validation, our model achieves an MAE of 0.81, 83.75% within-1 accuracy, 73.93% binary accuracy, and 68.45% binary Macro-F1, outperforming sensor-free, statistical, deep temporal, foundation-model, and LLM-based baselines. Our results suggest that fine-grained engagement estimation is feasible but inherently noisy, and that practical systems should prioritize lightweight combinations of behavioral and physiological signals over full multimodal instrumentation. We release the EduGage dataset, including synchronized multimodal sensor signals, probe-aligned momentary engagement labels, video metadata, quizzes, and study materials, to support reproducible research on fine-grained sensor-based engagement modeling in self-guided learning.

学习分析多模态感知专注度检测教育科技

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。