用学生学习日志预测每周练习时长和掌握新技能数,提升教学干预精准度。
From Heuristics to Analytics: Forecasting Effort and Progress in Online Learning

- 基于学习行为日志,用机器学习模型预测每周练习时长与技能掌握量。
- 相比传统经验规则,预测误差降低22%-33%,更准确追踪学生进步轨迹。
- 模型可解释性强,适合辅导教师结合目标设定与教学决策使用。
持续努力是智能辅导系统实现教学价值的关键,但许多学习者会中途放弃或使用不足。本文将参与度预测定义为基于ITS日志的监督学习任务,目标是预测每周练习分钟数和新掌握技能数。利用425名中学生一学年的真实交互日志,我们评估了包括回归、决策树和神经网络在内的15种预测器。结果表明,基于特征的模型相比启发式基线(如来自其他领域的固定百分位规则)将平均绝对误差(MAE)降低22%-33%。我们发现百分位启发法系统性高估,而特征模型能更好捕捉周级练习轨迹。通过特征重要性分析与消融实验,揭示出:努力预测主要依赖近期活动特征,进度预测则更受学习者状态与内容难度影响。在对8位大学生导师的半结构化访谈中,我们发现导师对努力与进度目标的思考方式,与模型分析模式一致。本研究建立了可复现的每周努力与进展预测基准,使持续努力与学习进展在周尺度上可视化,为师生共同设定目标与及时教学决策提供支持。
原文摘要 · Abstract (English)
Sustained effort is essential for realizing the benefits of intelligent tutoring systems (ITS), yet many learners disengage or underuse available practice time. We introduce engagement forecasting as a supervised prediction task based on ITS logs, targeting two outcomes central to effort and learning progress: minutes practiced per week and new skills mastered per week. Using interaction log data from 425 middle-school students over a school year, we benchmark fifteen predictors including regressions, decision trees, and neural networks. We show that these feature-based models reduce mean absolute error (MAE) by 22-33% relative to heuristic baselines, including fixed-percentile rules adapted from prior work in other behavioral domains. We find that percentile heuristics systematically overpredict, whereas feature-based models better track student practice trajectories across weeks. To support explainability, we analyze feature importance and ablations, revealing target-specific patterns: effort forecasting is driven mainly by recent activity features, while progress forecasting depends more on learner-state and content difficulty signals. Finally, in a semi-structured user interview case study with eight college tutors, we examine how tutors reasoned about system-generated predictive features when setting goals with students. We find that tutors reasoned differently about effort versus progress goals in ways that mirror our pattern analysis. Together, these results establish a reproducible benchmark for forecasting weekly effort and learning progress in ITS. By making patterns of sustained effort and progress visible at a weekly timescale, engagement forecasting offers a foundation for supporting tutor-learner goal setting and timely instructional decisions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。