用联邦学习保护隐私,实时检测在线学习中的走神与分心
Safeguarding Privacy: Privacy-Preserving Detection of Mind Wandering and Disengagement Using Federated Learning in Online Education
- 通过跨设备联邦学习训练模型,避免数据集中存储
- 在5个数据集上实现高精度的走神与分心检测
- 特别处理戴眼镜情况,适合教育科技领域应用
自新冠疫情以来,在线课程扩大了教育可及性,但缺乏教师直接支持,使学习者难以自我调节注意力与参与度。走神和分心会损害学习效果,基于视频指标的自动化检测成为实时学习支持的潜在方案。然而,传统机器学习方法常需共享敏感数据,引发隐私担忧。联邦学习提供了一种隐私保护的替代方案,支持去中心化模型训练并分散计算负载。本文提出一个框架,利用跨设备联邦学习识别远程学习中的行为与认知分心表现,包括行为分心、走神和无聊。采用面部表情与注视特征构建视频驱动的认知分心检测模型。通过联邦学习实现隐私优先设计,并引入新型实时学习支持方案。针对眼镜遮挡问题,加入相关特征以提升模型性能。在五个数据集上进行广泛实验,对比多种联邦学习算法。结果表明该方法在保障隐私的同时,显著提升了学习参与度监测能力。
原文摘要 · Abstract (English)
Since the COVID-19 pandemic, online courses have expanded access to education, yet the absence of direct instructor support challenges learners' ability to self-regulate attention and engagement. Mind wandering and disengagement can be detrimental to learning outcomes, making their automated detection via video-based indicators a promising approach for real-time learner support. However, machine learning-based approaches often require sharing sensitive data, raising privacy concerns. Federated learning offers a privacy-preserving alternative by enabling decentralized model training while also distributing computational load. We propose a framework exploiting cross-device federated learning to address different manifestations of behavioral and cognitive disengagement during remote learning, specifically behavioral disengagement, mind wandering, and boredom. We fit video-based cognitive disengagement detection models using facial expressions and gaze features. By adopting federated learning, we safeguard users' data privacy through privacy-by-design and introduce a novel solution with the potential for real-time learner support. We further address challenges posed by eyeglasses by incorporating related features, enhancing overall model performance. To validate the performance of our approach, we conduct extensive experiments on five datasets and benchmark multiple federated learning algorithms. Our results show great promise for privacy-preserving educational technologies promoting learner engagement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。