用手机眼动仪自动识别教师看谁,减少人工标注。
Automated Visual Attention Detection using Mobile Eye Tracking in Behavioral Classroom Studies
- 结合人脸检测与眼动数据,用迁移学习训练教室场景下的注意力识别模型。
- 在小教室和U型教室中准确率分别达0.7和0.9,表现良好。
- 无需大量人工标注,适合教育研究与教师培训场景。
教师在课堂中的视觉注意力及其在学生间的分布对学生成就、参与度及教师专业发展具有重要意义。然而,推断教师关注的具体学生并不容易。移动眼动追踪可提供关键帮助,但仅靠该技术需大量人工标注。为此,我们提出一种自动化处理流程,仅需少量人工标注即可识别教师注视的学生。方法上,利用先进的面部检测模型与人脸识别特征嵌入,通过迁移学习在教室环境中训练面部识别模型,并结合教师的眼动数据。我们在四个不同教室中评估该方法,结果表明,在所有教室设置下均能合理估计教师关注的学生;其中,U型教室和小教室表现最佳,准确率分别约为0.7和0.9。尽管未针对师生互动进行评估,但本方法不依赖大规模人工标注,且非侵入式,有望提升教学策略、优化课堂管理并为教师专业发展提供反馈。
原文摘要 · Abstract (English)
Teachers' visual attention and its distribution across the students in classrooms can constitute important implications for student engagement, achievement, and professional teacher training. Despite that, inferring the information about where and which student teachers focus on is not trivial. Mobile eye tracking can provide vital help to solve this issue; however, the use of mobile eye tracking alone requires a significant amount of manual annotations. To address this limitation, we present an automated processing pipeline concept that requires minimal manually annotated data to recognize which student the teachers focus on. To this end, we utilize state-of-the-art face detection models and face recognition feature embeddings to train face recognition models with transfer learning in the classroom context and combine these models with the teachers' gaze from mobile eye trackers. We evaluated our approach with data collected from four different classrooms, and our results show that while it is possible to estimate the visually focused students with reasonable performance in all of our classroom setups, U-shaped and small classrooms led to the best results with accuracies of approximately 0.7 and 0.9, respectively. While we did not evaluate our method for teacher-student interactions and focused on the validity of the technical approach, as our methodology does not require a vast amount of manually annotated data and offers a non-intrusive way of handling teachers' visual attention, it could help improve instructional strategies, enhance classroom management, and provide feedback for professional teacher development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。