用AI助手提升教师教学效果,让偏远学生获得优质教育。
Tutor CoPilot: A Human-AI Approach for Scaling Real-Time Expertise
- 用专家思维模型生成实时教学建议,辅助新手教师。
- 学生掌握知识点概率提高4个百分点,低水平教师学生受益9个百分点。
- 年成本仅20美元,适合教育资源匮乏地区推广。
生成式AI,特别是语言模型(LM),有潜力在社会影响重大的现实领域实现变革,尤其是在专家资源稀缺的情况下。例如,在教育领域,对新手教师进行专家指导对教学效果至关重要,但成本高昂,限制了教育质量的规模化提升。这尤其影响到长期被忽视的社区学生,他们最需要高质量教育。本文提出Tutor CoPilot,一种新型人-机协作系统,利用专家思维模型为正在授课的教师提供类专家指导。本研究是首个在真实教学场景中对人-机系统进行的随机对照试验,涉及900名教师和1800名来自历史弱势社区的K-12学生。根据预注册分析计划,结果显示,使用Tutor CoPilot的教师所教学生,主题掌握率高出4个百分点(p<0.01);尤其是低评分教师的学生,掌握率提升了9个百分点。Tutor CoPilot年均成本仅为每名教师20美元。通过分析超过55万条消息的分类器结果发现,使用该系统的教师更倾向于采用高质量教学策略(如提问引导理解),较少直接给出答案。教师访谈表明,系统能有效帮助回应学生需求,但也存在建议不符合年级水平等问题。总体而言,Tutor CoPilot证明了人-机系统可在现实领域规模化专家能力、弥合技能差距,推动高质量教育普惠化。
原文摘要 · Abstract (English)
Generative AI, particularly Language Models (LMs), has the potential to transform real-world domains with societal impact, particularly where access to experts is limited. For example, in education, training novice educators with expert guidance is important for effectiveness but expensive, creating significant barriers to improving education quality at scale. This challenge disproportionately harms students from under-served communities, who stand to gain the most from high-quality education. We introduce Tutor CoPilot, a novel Human-AI approach that leverages a model of expert thinking to provide expert-like guidance to tutors as they tutor. This study is the first randomized controlled trial of a Human-AI system in live tutoring, involving 900 tutors and 1,800 K-12 students from historically under-served communities. Following a preregistered analysis plan, we find that students working with tutors that have access to Tutor CoPilot are 4 percentage points (p.p.) more likely to master topics (p<0.01). Notably, students of lower-rated tutors experienced the greatest benefit, improving mastery by 9 p.p. We find that Tutor CoPilot costs only $20 per-tutor annually. We analyze 550,000+ messages using classifiers to identify pedagogical strategies, and find that tutors with access to Tutor CoPilot are more likely to use high-quality strategies to foster student understanding (e.g., asking guiding questions) and less likely to give away the answer to the student. Tutor interviews highlight how Tutor CoPilot's guidance helps tutors to respond to student needs, though they flag issues in Tutor CoPilot, such as generating suggestions that are not grade-level appropriate. Altogether, our study of Tutor CoPilot demonstrates how Human-AI systems can scale expertise in real-world domains, bridge gaps in skills and create a future where high-quality education is accessible to all students.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。