arXiv:2511.13271cs.SEcs.AI2025-11

GenAI提升编程任务完成度,但使用不当难促知识增长。

Examining the Usage of Generative AI Models in Student Learning Activities for Software Programming

  • 对比GenAI与传统资源,观察学生交互行为
  • 初学者用GenAI提分明显,但知识积累不足
  • 适度使用才能促进学习,需引导正确策略

生成式人工智能(GenAI)工具如ChatGPT的兴起为计算教育带来了新机遇与挑战。现有研究多关注GenAI完成教育任务的能力及其对学生表现的影响,却忽视了其对知识获取的作用。本研究通过控制用户实验,考察24名不同编程水平的本科生(初学者、中级者)在解决编程任务时使用ChatGPT的情况。分析了任务表现、概念理解及交互行为。结果表明:使用GenAI生成完整解决方案显著提升任务表现,尤其对初学者效果明显,但并未持续带来知识增长。值得注意的是,使用策略随经验差异而异:初学者倾向于依赖GenAI完成任务,缺乏知识获取;中级者则更选择性使用。我们发现,过度依赖或极少使用均导致较弱的知识增长。基于此,呼吁学生与教师将GenAI作为学习工具而非解题工具。研究强调,在编程教育中融入GenAI亟需指导,以促进深层理解。

原文摘要 · Abstract (English)

The rise of Generative AI (GenAI) tools like ChatGPT has created new opportunities and challenges for computing education. Existing research has primarily focused on GenAI's ability to complete educational tasks and its impact on student performance, often overlooking its effects on knowledge gains. In this study, we investigate how GenAI assistance compares to conventional online resources in supporting knowledge gains across different proficiency levels. We conducted a controlled user experiment with 24 undergraduate students of two different levels of programming experience (beginner, intermediate) to examine how students interact with ChatGPT while solving programming tasks. We analyzed task performance, conceptual understanding, and interaction behaviors. Our findings reveal that generating complete solutions with GenAI significantly improves task performance, especially for beginners, but does not consistently result in knowledge gains. Importantly, usage strategies differ by experience: beginners tend to rely heavily on GenAI toward task completion often without knowledge gain in the process, while intermediates adopt more selective approaches. We find that both over-reliance and minimal use result in weaker knowledge gains overall. Based on our results, we call on students and educators to adopt GenAI as a learning rather than a problem solving tool. Our study highlights the urgent need for guidance when integrating GenAI into programming education to foster deeper understanding.

生成式AI编程教育学习效果认知提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。