用AI+游戏化提升编程课互评质量,学生反馈量和质量双提高
Level Up Peer Review in Education: Investigating genAI-driven Gamification system and its influence on Peer Feedback Effectiveness
- 引入AI助手实时生成建设性评语,结合游戏机制激励互动
- 实验组反馈量显著增加,清晰度、相关性和具体性评分更高
- 适合想提升代码评审能力的高校师生及课程设计者
在软件工程教育中,代码审查与设计批判能力对职业发展至关重要,但传统教学中常被忽视,学生间互评质量与参与度差异显著。本文提出Socratique——一个集成生成式AI(GenAI)辅助的玩法化同伴评估平台,应用于函数式编程课程,旨在提升学生的互评技能。通过引入游戏元素激发学生主动提供反馈,同时利用GenAI实时协助生成高质量、建设性的评论。我们对硕士生开展随机对照实验,比较具有游戏化与AI支持的实验组与仅基础功能的对照组。结果显示,实验组学生提交的自愿反馈数量显著增多,且在清晰度、相关性和具体性三项关键指标上得分更高,证明了融合游戏化与AI对改善同伴评审过程的有效性,为软件工程课程中培养评审能力提供了实践依据。
原文摘要 · Abstract (English)
In software engineering (SE), the ability to review code and critique designs is essential for professional practice. However, these skills are rarely emphasized in formal education, and peer feedback quality and engagement can vary significantly among students. This paper introduces Socratique, a gamified peer-assessment platform integrated with Generative AI (GenAI) assistance, designed to develop students' peer-review skills in a functional programming course. By incorporating game elements, Socratique aims to motivate students to provide more feedback, while the GenAI assistant offers real-time support in crafting high quality, constructive comments. To evaluate the impact of this approach, we conducted a randomized controlled experiment with master's students comparing a treatment group with a gamified, GenAI-driven setup against a control group with minimal gamification. Results show that students in the treatment group provided significantly more voluntary feedback, with higher scores on clarity, relevance, and specificity - all key aspects of effective code and design reviews. This study provides evidence for the effectiveness of combining gamification and AI to improve peer review processes, with implications for fostering review-related competencies in software engineering curricula.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。