arXiv:2603.19535cs.HCcs.CV2026-03被引 2

VR手语学习中,视觉注意力强弱能预测学习效果。

Behavioral Engagement in VR-Based Sign Language Learning: Visual Attention as a Predictor of Performance and Temporal Dynamics

  • 用视觉注意力等行为数据自动评估学习投入度。
  • 视觉注意力与测试成绩显著正相关,解释了大部分表现差异。
  • 适合研究沉浸式教育或用户行为分析的学者参考。

本研究分析了面向手语训练与评测的虚拟现实应用SONAR中的学习者行为投入。聚焦三种自动提取的投入指标:视觉注意力(VA)、视频回放频率(VRF)和播放后观看时长(PPVT),考察其与学习绩效的关系。参与者完成自定节奏的训练阶段,随后进行保留性验证测验。采用皮尔逊相关分析检验各指标与测验成绩的关系,并通过二项广义线性模型(GLM)回归评估其联合预测能力。此外,通过汇总所有学习者的逐时刻视觉注意力轨迹,分析学习过程中的动态投入模式。结果显示,视觉注意力与测验成绩呈强正相关,其次为播放后观看时长,而回放频率无显著关联。二项式GLM确认视觉注意力与播放后观看时长是学习成功的重要预测因子,共同解释了显著比例的表现方差。进一步的时序分析揭示:注意力高峰与训练及测评视频中信息密集段对齐,呈现出初始适应、学习期振荡注意力循环以及测评期显著注意力峰值等阶段性特征。这些发现凸显持续且策略性分配的视觉注意力在VR手语学习中的核心作用,并展示了行为痕迹数据在理解与预测沉浸式环境中学习者投入的价值。

原文摘要 · Abstract (English)

This study analyzes behavioral engagement in SONAR, a virtual reality application designed for sign language training and validation. We focus on three automatically derived engagement indicators (Visual Attention (VA), Video Replay Frequency (VRF), and Post-Playback Viewing Time (PPVT)) and examine their relationship with learning performance. Participants completed a self-paced Training phase, followed by a Validation quiz assessing retention. We employed Pearson correlation analysis to examine the relationships between engagement indicators and quiz performance, followed by binomial Generalized Linear Model (GLM) regression to assess their joint predictive contributions. Additionally, we conducted temporal analysis by aggregating moment-to-moment VA traces across all learners to characterize engagement dynamics during the learning session. Results show that VA exhibits a strong positive correlation with quiz performance,followed by PPVT, whereas VRF shows no meaningful association. A binomial GLM confirms that VA and PPVT are significant predictors of learning success, jointly explaining a substantial proportion of performance variance. Going beyond outcome-oriented analysis, we characterize temporal engagement patterns by aggregating moment-to-moment VA traces across all learners. The temporal profile reveals distinct attention peaks aligned with informationally dense segments of both training and validation videos, as well as phase-specific engagement dynamics, including initial acclimatization, oscillatory attention cycles during learning, and pronounced attentional peaks during assessment. Together, these findings highlight the central role of sustained and strategically allocated visual attention in VR-based sign language learning and demonstrate the value of behavioral trace data for understanding and predicting learner engagement in immersive environments.

VR学习手语教育行为分析注意力预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。