arXiv:2608.26184cs.AIcs.HC2026-08中稿 · ACM UIST 2026, Det…

通过行为数据让AI编程辅导实时理解学生状态,提升辅导精准度。

TutorTrace: A Dataset and Taxonomy for Classifying Learner Behavioral States during AI-Assisted Programming Education

论文配图:TutorTrace: A Dataset and Taxonomy for Classifying Learner Behavioral States during AI-Assisted Programming Education
图 1 · 摘自论文原文
  • 从IDE操作日志提取行为片段,构建可计算的学习者状态分类体系。
  • 实测显示,行为感知提示使求助间隔中无独立编码时间占比从50%降至20.7%。
  • 适用于需要实时响应学习者状态的智能辅导系统研发与评估。

AI编程辅导虽具可扩展性,却缺乏人类导师依赖的行为上下文来调整支持策略。我们提出TutorTrace,一个数据集与行为抽象流程,能够从低层IDE遥测数据中实时可视化并计算学习者的行为上下文。在两门初级Python课程中四次部署(共480名学习者),TutorTrace捕获约18万条遥测事件、13,633个行为段落及27个持续计算的指标。基于此,我们构建了学习者活动的分类体系,涵盖首次求助前、连续求助之间以及整个会话期间的状态。该体系使系统不仅能回应学习者说什么,还能理解其求助前的行为轨迹。初步课堂评估显示,行为感知提示使‘求助间隔中无独立工作’的比例从50.0%下降至20.7%。作为下游应用示范,我们在两个保留任务上评估TutorTrace:预测学习者是否将在未来60秒内求助(AUROC=0.726),以及判断即将到来的求助是引导式还是依赖式(AUROC=0.717)。这些结果表明,行为上下文可实现规模化自适应AI辅导。

原文摘要 · Abstract (English)

AI programming tutors provide scalable support, yet lack the behavioral context human tutors rely on to adapt support to learners' needs. We present TutorTrace, a dataset and behavioral abstraction pipeline that makes learners' behavioral context visible and computable in real time from low-level IDE telemetry. Across four deployments in two introductory Python courses (N=480), TutorTrace captures approximately 180K telemetry events, 13,633 behavioral segments, and 27 continuously computed metrics. From this foundation, we derive a taxonomy of learner activity before the first AI query, between consecutive queries, and across the full session, enabling systems to respond not just to what learners say, but to what they have done leading up to the help-seeking moment. In a preliminary classroom evaluation, behavior-aware prompts were associated with a decrease in intervals between queries with no independent work from 50.0% to 20.7%. As an additional demonstration of downstream utility, we evaluate TutorTrace on two held-out prediction tasks: whether a learner will query within the next 60 seconds (AUROC=.726) and whether an upcoming query reflects guided or dependent help-seeking (AUROC=.717). Together, these findings show how behavioral context can enable adaptive AI tutoring at scale.

AI辅导行为分析编程教育实时反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。