用多样化的代码解释提升编程初学者理解力,效果更好但不增加负担。
Exploring the Value of Diverse LLM Explanations in Introductory Programming

- 对比单一通用解释,采用多角度(功能/概念/目标)的多样化解释
- 学生答题准确率平均高7.7%,认知负荷无显著差异
- 适合教育类AI应用,尤其面向编程入门学习者
大型语言模型(LLMs)已展现出生成质量优于同龄人代码解释的潜力,为计算机科学教育带来新机遇。尽管其解释深度和清晰度尚不及教师,但计算创造力研究指出,想法的数量与多样性常胜过单一高质量输出。受此启发,我们探究将多个强调不同方面(如功能、概念、目标)的多样化解释组合使用,是否比仅提供无侧重通用解释更能提升学生对编程练习的理解。在本研究中,971名大一计算机专业学生被随机分配至多样化或通用型解释组,针对两个编程练习完成选择题、开放题,随后填写量表题及开放反思。结果表明,在两种解释条件下,学生表现与感知认知负荷存在规律性差异。数据显示,接收多样化解释的学生在开放题回答中的准确率平均高出约7.7%,且感知负担无明显变化。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have shown the potential to generate code explanations that surpass those of peers in quality, offering promising opportunities for computer science education. While these explanations may not yet match the depth and clarity of instructor-provided explanations, research in computational creativity highlights that the quantity and diversity of ideas can often outweigh a singular focus on quality. Inspired by this, we explore whether combining multiple diverse explanations, each emphasizing distinct aspects (e.g., function, concept, goal), can enhance students' understanding of programming exercises compared to generic explanations that do not emphasize distinct conceptual aspects. In our study 971 first-year computing students were randomly assigned either diverse or generic LLM-generated explanations for two programming exercises. Students completed multiple-choice and open-ended questions for each exercise, followed by Likert-scale questions and open-ended reflections. Our findings outline patterns in student performance and perceived cognitive load across the two explanation conditions. These findings highlight how variation in explanation emphasis may relate to learner engagement and understanding. Across participants, open-ended response accuracy was consistently about 7.7% higher when students received diverse explanations, with no difference in perceived cognitive load.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。