arXiv:2606.18617cs.CYcs.AI2026-06中稿 · EC-TEL 2026

用AI分析真实教学记录,验证培训效果能否落地。

AI-Driven Assessment of Human Tutors: Linking Training Performance to Real-Life Practice

论文配图:AI-Driven Assessment of Human Tutors: Linking Training Performance to Real-Life Practice
图 1 · 摘自论文原文
  • 用Gemini-2.5-pro分析真实授课转录文本,评估培训迁移效果。
  • 培训表现可预测真实教学得分,效应量达0.25标准差。
  • 适合教育科技、教师培训与AI评估研究者参考。

现有导师培训平台多缺乏基于真实表现的AI评估。本文提出一种基于生成式AI(Gemini-2.5-pro)的系统,分析86名远程数学导师在六个情境化课程中的真实授课转录,评估培训效果向实际教学的迁移。平均学习提升达7.4%。混合效应模型分析405对会话-课程数据发现,培训表现显著预测真实教学得分(效应量0.25标准差)。模型比较显示,综合开放题与选择题表现的评估方式最优,但开放题更具预测力。探索性分析表明,培训后导师更可能抓住教学机会(61.1%升至68.9%),且执行质量更高(65.5%升至68.1%)。中断时间序列分析显示改进为渐进趋势,非即时干预结果。研究提供开源数据集、AI提示词与评分量表,支持透明与可复现。

原文摘要 · Abstract (English)

There exist numerous tutor training platforms. However, few provide AI-driven training and evaluation for human tutors based on real-life performance. We present an AI-driven system that assesses both open responses during training and authentic real-life tutoring. Unlike platforms that only assess learning through online training or simulations, our system utilizes Generative AI (Gemini-2.5-pro) to analyze transcriptions of authentic tutoring, measuring the transfer of tutor skills to real-life application. Human tutors instructing students remotely in math (N=86) completed six scenario-based lessons, averaging a significant 7.4% learning gain. Using mixed-effects models across 405 session-to-lesson pairs, we found that training performance significantly predicted real-life transcript scores with an effect size of 0.25 SD. Model comparison (AIC/BIC) indicated averaging open response and multiple choice performance during training predicted real-life tutor performance best, although open responses were comparatively more predictive. Exploratory analysis showed that after training, tutors were significantly more likely to encounter pedagogical opportunities to apply their skills (61.1% to 68.9%) and demonstrated higher execution quality within those opportunities (65.5% to 68.1%). Interrupted time series analysis suggested that these tutor improvements were part of a gradual trend over time rather than an immediate intervention effect of training. We illustrate an AI-driven method to link tutor training with real-life assessment. In doing so, we contribute open datasets, AI prompts, and scoring rubrics to support transparency and reproducibility.

AI评估教师培训生成式AI教育技术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。