教学生用好AI助手,提升编程学习效果
Improving Student-AI Interaction Through Pedagogical Prompting: An Example in Computer Science Education
- 设计教学提示框架,引导AI输出助学习的回答
- 实测显示学生提问能力显著提升,愿持续使用
- 适合高校编程课教师与想用AI自学的人
自2022年以来,大语言模型(LLM)在教育中的应用引发广泛关注。研究表明,学生不当使用LLM会损害学习成效。本文提出「教学提示」概念,旨在引导学生有效提问以促进学习。研究选取本科生计算机入门课程(CS1/CS2)为场景,通过36位授课教师的前期调研,结合课堂需求设计互动式教学干预。开发基于情境的交互系统,帮助学生训练教学提示技能。通过22名初学者的前后测用户研究,混合方法分析显示:学生基于LLM的求助能力显著提升,对系统评价积极,未来更愿意使用教学提示。贡献包括:(1) 教学提示的理论框架;(2) 教师对教学提示的态度实证发现;(3) 具有前景的交互式教学工具与情境化教学设计。该方法可扩展至更多课堂,亦可集成至ChatGPT等工具作为入门引导,推动生成式AI的有意义使用。
原文摘要 · Abstract (English)
With the proliferation of large language model (LLM) applications since 2022, their use in education has sparked both excitement and concern. Recent studies consistently highlight students' (mis)use of LLMs can hinder learning outcomes. This work aims to teach students how to effectively prompt LLMs to improve their learning. We first proposed pedagogical prompting, a theoretically-grounded new concept to elicit learning-oriented responses from LLMs. To move from concept design to a proof-of-concept learning intervention in real educational settings, we selected early undergraduate CS education (CS1/CS2) as the example context. We began with a formative survey study with instructors (N=36) teaching early-stage undergraduate-level CS courses to inform the instructional design based on classroom needs. Based on their insights, we designed and developed a learning intervention through an interactive system with scenario-based instruction to train pedagogical prompting skills. Finally, we evaluated its instructional effectiveness through a user study with CS novice students (N=22) using pre/post-tests. Through mixed methods analyses, our results indicate significant improvements in learners' LLM-based pedagogical help-seeking skills, along with positive attitudes toward the system and increased willingness to use pedagogical prompts in the future. Our contributions include (1) a theoretical framework of pedagogical prompting; (2) empirical insights into current instructor attitudes toward pedagogical prompting; and (3) a learning intervention design with an interactive learning tool and scenario-based instruction leading to promising results on teaching LLM-based help-seeking. Our approach is scalable for broader implementation in classrooms and has the potential to be integrated into tools like ChatGPT as an on-boarding experience to encourage learning-oriented use of generative AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。