用语音AI助教教初中生学编程，发现反馈准确率71.4%。
GenAI Voice Mode in Programming Education
- 用实时语音AI tutor辅助学生编程，收集1210条对话
- AI反馈正确率71.4%，代码输出常出错
- 学生主要用来调试，认为它灵活但不够像人
使用多模态生成式AI（GenAI）的实时语音接口可能有助于解决视障等残疾新手程序员的可及性问题。然而，目前尚不清楚新手如何与GenAI工具互动及其音频反馈的质量。本研究分析了九名九年级学生在真实课堂环境中使用基于OpenAI Realtime API的语音助教学习Python时的音频对话（共1210条消息），通过定性编码分析学生提问与AI回复内容，并通过同伴建模问卷收集学生感知。结果显示，该语音助教主要提供错误纠正和下一步建议，但其准确性有限（416次反馈中正确率为71.4%）。尤其当AI尝试朗读编程代码元素时，质量问题明显。学生主要将语音助教用于调试，认为其具备能力但仅部分拟人化且具有灵活性。本研究首次探索了实时语音GenAI助教与新手程序员的交互动态，为未来教育工具设计提供依据，或可满足多样化学习者的可及性需求。
原文摘要 · Abstract (English)
Real-time voice interfaces using multimodal Generative AI (GenAI) can potentially address the accessibility needs of novice programmers with disabilities (e.g., related to vision). Yet, little is known about how novices interact with GenAI tools and their feedback quality in the form of audio output. This paper analyzes audio dialogues from nine 9th-grade students using a voice-enabled tutor (powered by OpenAI's Realtime API) in an authentic classroom setting while learning Python. We examined the students' voice prompts and AI's responses (1210 messages) by using qualitative coding. We also gathered students' perceptions via the Partner Modeling Questionnaire. The GenAI Voice Tutor primarily offered feedback on mistakes and next steps, but its correctness was limited (71.4% correct out of 416 feedback outputs). Quality issues were observed, particularly when the AI attempted to utter programming code elements. Students used the GenAI voice tutor primarily for debugging. They perceived it as competent, only somewhat human-like, and flexible. The present study is the first to explore the interaction dynamics of real-time voice GenAI tutors and novice programmers, informing future educational tool design and potentially addressing accessibility needs of diverse learners.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。