研究学生如何向编程助教机器人要反馈,发现要得准且响应对。
Students' Feedback Requests and Interactions with the SCRIPT Chatbot: Do They Get What They Ask For?
- 用预设提示+自由对话设计聊天机器人SCRIPT,支持初学者编程
- 75%的回复与学生请求的反馈类型一致,系统指令遵守率高
- 适合关注AI助学工具设计与人机交互平衡的研究者
基于生成式人工智能(GenAI)在编程教育中的应用,我们开发了基于ChatGPT-4o-mini的SCRIPT聊天机器人,为编程初学者提供支持。该系统支持开放式互动与结构化引导,通过预设提示实现教学干预。我们在德国一所大型大学的入门编程课程中开展实验,共招募136名学生,分析他们在完成编程任务时与SCRIPT的交互行为及其反馈偏好。结果表明,学生提出反馈请求具有特定顺序;75%的机器人回复与学生所请求的反馈类型相符,且严格遵循系统提示约束。研究揭示了生成式AI辅助学习系统的设计规律,并指出了在指导性与灵活性之间取得平衡的挑战。
原文摘要 · Abstract (English)
Building on prior research on Generative AI (GenAI) and related tools for programming education, we developed SCRIPT, a chatbot based on ChatGPT-4o-mini, to support novice learners. SCRIPT allows for open-ended interactions and structured guidance through predefined prompts. We evaluated the tool via an experiment with 136 students from an introductory programming course at a large German university and analyzed how students interacted with SCRIPT while solving programming tasks with a focus on their feedback preferences. The results reveal that students' feedback requests seem to follow a specific sequence. Moreover, the chatbot responses aligned well with students' requested feedback types (in 75%), and it adhered to the system prompt constraints. These insights inform the design of GenAI-based learning support systems and highlight challenges in balancing guidance and flexibility in AI-assisted tools.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。