用大模型生成问答题,学生记忆效果提升明显。
Enhancing Student Learning with LLM-Generated Retrieval Practice Questions: An Empirical Study in Data Science Courses
- 用大模型根据课程内容自动生成选择题
- 实验组一周答题后准确率达89%,对照组73%
- 适合想高效备课的教师,需人工校对题目
检索练习是一种被广泛验证的高效教学方法,能显著提升学习效果和知识留存。但在快速发展的技术课程中,高质量检索题的制作对教师而言耗时费力。大语言模型(LLMs)可通过提示生成问题,具备自动化潜力,但其在真实教学中的有效性尚未明确。本研究在两门高校数据科学课程中开展实证实验,共约60名学生参与。对比学生在一周内接受LLM生成的选择题检索练习与无此类练习的一周的学习成效。结果表明,使用LLM生成检索练习的学生知识留存率更高,平均准确率达89%,而对照组为73%。研究显示,LLM生成的检索题可有效支持学习,可能为实时教学提供可扩展的解决方案。然而,尽管效果显著且节省时间,仍需谨慎:生成题目的质量参差不齐,教师仍需手动核查与修改后方可发布。
原文摘要 · Abstract (English)
Retrieval practice is a well-established pedagogical technique known to significantly enhance student learning and knowledge retention. However, generating high-quality retrieval practice questions is often time-consuming and labor intensive for instructors, especially in rapidly evolving technical subjects. Large Language Models (LLMs) offer the potential to automate this process by generating questions in response to prompts, yet the effectiveness of LLM-generated retrieval practice on student learning remains to be established. In this study, we conducted an empirical study involving two college-level data science courses, with approximately 60 students. We compared learning outcomes during one week in which students received LLM-generated multiple-choice retrieval practice questions to those from a week in which no such questions were provided. Results indicate that students exposed to LLM-generated retrieval practice achieved significantly higher knowledge retention, with an average accuracy of 89%, compared to 73% in the week without such practice. These findings suggest that LLM-generated retrieval questions can effectively support student learning and may provide a scalable solution for integrating retrieval practice into real-time teaching. However, despite these encouraging outcomes and the potential time-saving benefits, cautions must be taken, as the quality of LLM-generated questions can vary. Instructors must still manually verify and revise the generated questions before releasing them to students.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。