arXiv:2609.06212cs.CL2026-09

首个评估AI生成课件教学效果的基准,发现美观不等于有效。

SLATE: Are AI-Generated Slides Educationally Effective? A Benchmark for Language Teaching Quality and Learner Knowledge Acquisition

论文配图:SLATE: Are AI-Generated Slides Educationally Effective? A Benchmark for Language Teaching Quality and Learner Knowledge Acquisition
图 1 · 摘自论文原文
  • 构建90个标准化教学单元,用竞赛题库生成可测学习任务。
  • 内容质量与学习提升弱相关,教学设计影响显著正向效果。
  • 多数模型近远迁移差距大,顶尖模型仍可能导致负学习收益。

大型语言模型在生成语言教学幻灯片方面已取得显著进展,但视觉精致度与实际教学有效性之间仍存在显著差距。为填补这一空白,我们提出SLATE(基于幻灯片的教学有效性学习评估),这是首个通过教学有效性与学习者知识获取双重维度评估AI生成语言教学幻灯片的基准。SLATE将低资源语言的国际语言学奥林匹克竞赛题目转化为90个标准化教学单元,包含1,133个可评估项目,并配有结构化课程大纲及匹配的近迁移与远迁移测试集。采用预测试-后测试设计,杜绝预存知识泄露,确保成绩增长反映真实学习而非记忆。利用视觉语言模型作为可扩展的学习者代理,辅以三系统人类试点方向性验证,结果表明:内容有效性与学习增益呈弱关联,而教学设计则呈现强正向关联。此外,大多数系统在近迁移与远迁移准确率间存在显著差距,甚至前沿模型也可能出现负学习增益。SLATE揭示了教学成果与成品质量之间的脱节,呼吁重构生成式教学系统的构建、评估与部署范式。

原文摘要 · Abstract (English)

LLMs have achieved remarkable capabilities in generating language teaching slides. However, a critical mismatch persists between visual polish and actual instructional effectiveness. To address this gap, we introduce SLATE (Slide-based Learning Assessment for Teaching Effectiveness), the first benchmark that evaluates AI-generated language teaching slides through instructional effectiveness and learner knowledge acquisition. SLATE transforms linguistics olympiad puzzles from low-resource languages with negligible web presence into 90 standardized instructional units comprising 1,133 assessable items, paired with a structured course outline and matched near- and far-transfer test sets. This pretest-posttest design eliminates pretrained knowledge leakage, ensuring gains reflect learning rather than prior recall. Using VLMs as scalable learner proxies and directionally supported by a three-system human pilot, our results show that content validity exhibits a weak association with learning gain, while pedagogical design exhibits a robust positive association. Moreover, most systems show a significant gap between near- and far-transfer accuracy, and even frontier models can produce negative learning gains. SLATE reveals a dissociation between artifact quality and instructional effectiveness, calling for a paradigm shift in how generative teaching systems are built, evaluated, and deployed.

教育AI教学评估学习迁移LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。