用学生初期几小时学习数据,预测长期考试表现。
Predicting Long-Term Student Outcomes from Short-Term EdTech Log Data
- 仅用前2-5小时学习日志,构建长期表现预测模型。
- 在乌干达和美国三组数据上均实现有效预测。
- 适合教育机构快速识别高风险学生。
教育相关方常关注稀疏且延迟的学生成果,如学年末的州级考试成绩。此类评估罕见,导致难以及时识别可能不及格的学生,也延缓了对教育工具效果的评估。以往研究多基于学生完整使用周期(如全年)的日志或短时间(如1小时)内数据进行预测。本文则探究学生前几小时使用数据是否能为学年末外部评估提供有效预测。我们在三个不同数据集上验证:乌干达学生使用识字游戏产品,以及美国学生使用两个数学智能辅导系统。评估了多种预测准确率指标,包括在成绩分布不同区间识别学生的效能。结果表明,仅需2-5小时的短期日志数据,即可为长期外部表现提供有价值信号。
原文摘要 · Abstract (English)
Educational stakeholders are often particularly interested in sparse, delayed student outcomes, like end-of-year statewide exams. The rare occurrence of such assessments makes it harder to identify students likely to fail such assessments, as well as making it slow for researchers and educators to be able to assess the effectiveness of particular educational tools. Prior work has primarily focused on using logs from students full usage (e.g. year-long) of an educational product to predict outcomes, or considered predictive accuracy using a few minutes to predict outcomes after a short (e.g. 1 hour) session. In contrast, we investigate machine learning predictors using students' logs during their first few hours of usage can provide useful predictive insight into those students' end-of-school year external assessment. We do this on three diverse datasets: from students in Uganda using a literacy game product, and from students in the US using two mathematics intelligent tutoring systems. We consider various measures of the accuracy of the resulting predictors, including its ability to identify students at different parts along the assessment performance distribution. Our findings suggest that short-term log usage data, from 2-5 hours, can be used to provide valuable signal about students' long-term external performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。