新模型通过行为特征检测粗心错误,发现传统方法与结果相反。
Carelessness Detection using Performance Factor Analysis: A New Operationalization with Unexpectedly Different Relationship to Learning
- 用行为数据和性能因子分析替代概率模型检测粗心
- 粗心错误与成绩正相关(旧模型)或负相关(新模型)
- 适合教育数据挖掘与学习行为分析研究者
数字学习平台中粗心错误的检测长期依赖上下文滑失模型,该模型基于条件概率与贝叶斯知识追踪(BKT)识别学生有知识却出错的情况。然而,该模型在多技能题目中表现不佳,因受限于条件概率机制。为此,本文提出新的超越知识特征粗心检测模型(BKFC),利用性能因子分析(PFA)与日志数据提取的行为特征,在控制知识水平的前提下识别粗心错误。实验基于初中生在小数与运算学习游戏中的数据,对比了上下文滑失模型与BKFC模型的检测结果。出人意料的是,两种方法识别的粗心错误几乎不重合。进一步分析发现,使用上下文滑失模型检测到的粗心与学生后测成绩呈正相关,而使用BKFC模型检测到的粗心则与后测成绩呈负相关。这一结果揭示了粗心行为的复杂性,也凸显了粗心操作化定义面临的深层挑战。
原文摘要 · Abstract (English)
Detection of carelessness in digital learning platforms has relied on the contextual slip model, which leverages conditional probability and Bayesian Knowledge Tracing (BKT) to identify careless errors, where students make mistakes despite having the knowledge. However, this model cannot effectively assess carelessness in questions tagged with multiple skills due to the use of conditional probability. This limitation narrows the scope within which the model can be applied. Thus, we propose a novel model, the Beyond Knowledge Feature Carelessness (BKFC) model. The model detects careless errors using performance factor analysis (PFA) and behavioral features distilled from log data, controlling for knowledge when detecting carelessness. We applied the BKFC to detect carelessness in data from middle school students playing a learning game on decimal numbers and operations. We conducted analyses comparing the careless errors detected using contextual slip to the BKFC model. Unexpectedly, careless errors identified by these two approaches did not align. We found students' post-test performance was (corresponding to past results) positively associated with the carelessness detected using the contextual slip model, while negatively associated with the carelessness detected using the BKFC model. These results highlight the complexity of carelessness and underline a broader challenge in operationalizing carelessness and careless errors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。