arXiv:2510.26402cs.AIcs.LG2025-10被引 4

AI自动批改系统升级,能生成有教学意义的反馈并可视化学生代码模式。

Autograder+: A Multi-Faceted AI Framework for Rich Pedagogical Feedback in Programming Education

  • 用微调大模型自动生成符合教学逻辑的反馈
  • 在600份提交中反馈语义与教师评语高度一致
  • 支持代码聚类与提示模板定制,适合教学评估场景

编程教育的快速发展已超出传统评估工具的能力范围,教师难以提供有意义且可扩展的反馈。传统自动批改系统仅返回通过/未通过结果,缺乏对学生思维和学习需求的洞察。Autograder+旨在将自动批改从总结性评价转变为形成性学习体验。它引入两项核心能力:利用微调的大语言模型自动生成反馈,以及通过可视化呈现学生代码提交以揭示学习模式。模型在精选的学生代码与专家反馈数据上进行微调,确保反馈具有教学一致性与上下文感知能力。在多个编程任务的600份学生提交中评估显示,系统生成的反馈与教师评论具有强语义一致性。在可视化方面,基于1,000个标注样本训练的对比学习代码嵌入,可按功能与解法思路将代码分组为有意义的簇。系统还支持提示池机制,允许教师通过选择提示模板引导反馈风格。通过整合AI驱动反馈、语义聚类与交互式可视化,Autograder+降低了教师工作量,同时支持精准教学,促进更优学习效果。

原文摘要 · Abstract (English)

The rapid growth of programming education has outpaced traditional assessment tools, leaving faculty with limited means to provide meaningful, scalable feedback. Conventional autograders, while efficient, act as black-box systems that simply return pass/fail results, offering little insight into student thinking or learning needs. Autograder+ is designed to shift autograding from a purely summative process to a formative learning experience. It introduces two key capabilities: automated feedback generation using a fine-tuned Large Language Model, and visualization of student code submissions to uncover learning patterns. The model is fine-tuned on curated student code and expert feedback to ensure pedagogically aligned, context-aware guidance. In evaluation across 600 student submissions from multiple programming tasks, the system produced feedback with strong semantic alignment to instructor comments. For visualization, contrastively learned code embeddings trained on 1,000 annotated submissions enable grouping solutions into meaningful clusters based on functionality and approach. The system also supports prompt-pooling, allowing instructors to guide feedback style through selected prompt templates. By integrating AI-driven feedback, semantic clustering, and interactive visualization, Autograder+ reduces instructor workload while supporting targeted instruction and promoting stronger learning outcomes.

自动批改AI教学代码分析学习反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。