用计算机视觉实时分析在线学习者注意力,帮老师及时了解学生状态。
Learner Attentiveness and Engagement Analysis in Online Education Using Computer Vision
- 基于卷积神经网络的多任务分类模型,从视频中识别注意力与情绪状态。
- 在公开数据集DAiSEE上实现比现有方法更高的注意力检测准确率。
- 提供端到端实时分析系统,适合教育机构快速部署使用。
近年来,在线教育和视频会议平台的使用急剧增长。由于虚拟课堂的局限性,教师难以实时评估学习者的注意力和理解程度。在数字化教学环境中,若能有自动化反馈机制让教师随时了解学习者的注意力水平,将极大提升教学效果。本研究提出一种基于计算机视觉的新方法,用于分析和量化在线学习场景中学习者的注意力、参与度及其他情感状态。研究基于公开数据集DAiSEE,开发了一种多类别多输出分类方法,采用卷积神经网络进行建模,并在此基础上构建了机器学习算法,输出综合的注意力指数。此外,提出一个端到端处理流程,可实时处理学习者视频流,向教师提供详细的注意力分析报告。实验结果表明,该方法在注意力检测性能上优于现有先进方法。所提出的系统具备全面性、实用性与实时性,易于部署且操作简便。实验还验证了该系统在评估学习者注意力方面的高效性。
原文摘要 · Abstract (English)
In recent times, online education and the usage of video-conferencing platforms have experienced massive growth. Due to the limited scope of a virtual classroom, it may become difficult for instructors to analyze learners' attention and comprehension in real time while teaching. In the digital mode of education, it would be beneficial for instructors to have an automated feedback mechanism to be informed regarding learners' attentiveness at any given time. This research presents a novel computer vision-based approach to analyze and quantify learners' attentiveness, engagement, and other affective states within online learning scenarios. This work presents the development of a multiclass multioutput classification method using convolutional neural networks on a publicly available dataset - DAiSEE. A machine learning-based algorithm is developed on top of the classification model that outputs a comprehensive attentiveness index of the learners. Furthermore, an end-to-end pipeline is proposed through which learners' live video feed is processed, providing detailed attentiveness analytics of the learners to the instructors. By comparing the experimental outcomes of the proposed method against those of previous methods, it is demonstrated that the proposed method exhibits better attentiveness detection than state-of-the-art methods. The proposed system is a comprehensive, practical, and real-time solution that is deployable and easy to use. The experimental results also demonstrate the system's efficiency in gauging learners' attentiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。