arXiv:2504.17824cs.SEcs.AI2025-04

用大模型自动解编程题,还能个性化教学和修错。

EduBot -- Can LLMs Solve Personalized Learning and Programming Assignments?

  • 通过递归提示驱动,自动完成复杂编程任务。
  • 20个场景平均18分钟内完成,无需微调大模型。
  • 适合教育场景中个性化编程辅导与自动评测。

大型语言模型(LLMs)正在改变代码编写方式。通用和代码专用的LLMs在单次查询的函数生成与补全任务中表现优异,但在处理包含递归请求与调试的综合编程任务时仍存疑。本文提出EduBot,一个智能自动化助教系统,结合概念教学、端到端代码开发、递归提示驱动的个性化编程及有限人工干预下的调试能力,利用预训练的LLMs实现多步推理与代码生成。EduBot可解决从概念理解到编码的渐进式子任务,无需对大模型进行微调。我们设计并执行了一个包含算法、机器学习与真实问题的20个场景基准测试,结果表明其多数任务可在20分钟内完成。通过对比不同能力的LLMs作为核心,验证了EduBot在跨模型上的兼容性与鲁棒性。EduBot探索了预训练大模型在个性化作业中知识学习与代码生成的潜力。

原文摘要 · Abstract (English)

The prevalence of Large Language Models (LLMs) is revolutionizing the process of writing code. General and code LLMs have shown impressive performance in generating standalone functions and code-completion tasks with one-shot queries. However, the ability to solve comprehensive programming tasks with recursive requests and bug fixes remains questionable. In this paper, we propose EduBot, an intelligent automated assistant system that combines conceptual knowledge teaching, end-to-end code development, personalized programming through recursive prompt-driven methods, and debugging with limited human interventions powered by LLMs. We show that EduBot can solve complicated programming tasks consisting of sub-tasks with increasing difficulties ranging from conceptual to coding questions by recursive automatic prompt-driven systems without finetuning on LLMs themselves. To further evaluate EduBot's performance, we design and conduct a benchmark suite consisting of 20 scenarios in algorithms, machine learning, and real-world problems. The result shows that EduBot can complete most scenarios in less than 20 minutes. Based on the benchmark suites, we perform a comparative study to take different LLMs as the backbone and to verify EduBot's compatibility and robustness across LLMs with varying capabilities. We believe that EduBot is an exploratory approach to explore the potential of pre-trained LLMs in multi-step reasoning and code generation for solving personalized assignments with knowledge learning and code generation.

编程教育大模型应用自动化辅导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。