用微调的AI模型辅助教学,效果不输真人且成本更低。
AI tutoring can safely and effectively support students: An exploratory RCT in UK classrooms
- AI模型在教师监督下生成教学内容,76.4%的内容无需修改即可使用。
- 学生使用AI辅导后解决新问题的能力提升5.5个百分点,达66.2%。
- 适合想低成本实现个性化教学的教育机构或教师使用。
一对一辅导被视为个性化教育的黄金标准,但难以规模化。为评估生成式AI是否可扩展该资源,我们在英国五所中学开展了探索性随机对照试验(RCT),参与学生共165名。将针对教学优化的生成式AI模型LearnLM集成至Eedi数学平台的聊天辅导中。在试验中,专家导师全程监督LearnLM,仅在满意时才允许其发送消息。结果显示,76.4%的模型生成内容经导师审核后无需修改(仅改动一两个字符)。这对应有效教学支持:使用LearnLM的学生在各项学习指标上表现至少与真人导师组相当。事实上,使用AI辅导的学生在后续新主题中解决复杂问题的概率高出5.5个百分点(成功率达66.2%),高于仅接受人类导师辅导组的60.7%。访谈显示,导师认为该模型在设计苏格拉底式提问方面表现突出,能促进学生深度思考,多位导师甚至从中学习到新的教学策略。总体表明,经过教学微调的AI辅导系统有望在规模化提供高效个性化学习支持方面发挥重要作用。
原文摘要 · Abstract (English)
One-to-one tutoring is widely considered the gold standard for personalized education, yet it remains prohibitively expensive to scale. To evaluate whether generative AI might help expand access to this resource, we conducted an exploratory randomized controlled trial (RCT) with $N = 165$ students across five UK secondary schools. We integrated LearnLM -- a generative AI model fine-tuned for pedagogy -- into chat-based tutoring sessions on the Eedi mathematics platform. In the RCT, expert tutors directly supervised LearnLM, with the remit to revise each message it drafted until they would be satisfied sending it themselves. LearnLM proved to be a reliable source of pedagogical instruction, with supervising tutors approving 76.4% of its drafted messages making zero or minimal edits (i.e., changing only one or two characters). This translated into effective tutoring support: students guided by LearnLM performed at least as well as students chatting with human tutors on each learning outcome we measured. In fact, students who received support from LearnLM were 5.5 percentage points more likely to solve novel problems on subsequent topics (with a success rate of 66.2%) than those who received tutoring from human tutors alone (rate of 60.7%). In interviews, tutors highlighted LearnLM's strength at drafting Socratic questions that encouraged deeper reflection from students, with multiple tutors even reporting that they learned new pedagogical practices from the model. Overall, our results suggest that pedagogically fine-tuned AI tutoring systems may play a promising role in delivering effective, individualized learning support at scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。