用AI自动批改学生编程作业,即时反馈且保护隐私
PyEvalAI: AI-assisted evaluation of Jupyter Notebooks for immediate personalized feedback
- 结合单元测试与本地运行的AI模型,自动评分Jupyter笔记本
- 案例显示批改速度提升明显,可缩短一周的等待时间
- 开源免费,导师全程掌控评分,适合高校理工课程使用
STEM课程作业批改对教师而言费时费力,常需一周完成全班评分。对学生而言,反馈延迟导致无法及时修正错误,影响学习效果并加剧考试压力。现有AI辅助教学系统虽能提供即时反馈、减轻工作量,但普遍存在隐私问题、依赖闭源模型、不支持Markdown、LaTeX与Python代码混合,或排除导师参与评分。为此,我们提出PyEvalAI,一个AI辅助评估系统,通过单元测试与本地部署的语言模型自动评分Jupyter笔记本,保障隐私。该方法开源免费,确保导师全程控制评分流程。案例研究显示,在大学数值分析课程中,其显著提升了反馈速度与批改效率。
原文摘要 · Abstract (English)
Grading student assignments in STEM courses is a laborious and repetitive task for tutors, often requiring a week to assess an entire class. For students, this delay of feedback prevents iterating on incorrect solutions, hampers learning, and increases stress when exercise scores determine admission to the final exam. Recent advances in AI-assisted education, such as automated grading and tutoring systems, aim to address these challenges by providing immediate feedback and reducing grading workload. However, existing solutions often fall short due to privacy concerns, reliance on proprietary closed-source models, lack of support for combining Markdown, LaTeX and Python code, or excluding course tutors from the grading process. To overcome these limitations, we introduce PyEvalAI, an AI-assisted evaluation system, which automatically scores Jupyter notebooks using a combination of unit tests and a locally hosted language model to preserve privacy. Our approach is free, open-source, and ensures tutors maintain full control over the grading process. A case study demonstrates its effectiveness in improving feedback speed and grading efficiency for exercises in a university-level course on numerics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。