用AI自动批改手写理工科作业，省时65%且准确率超95%。
Pensieve Grader: An AI-Powered, Ready-to-Use Platform for Effortless Handwritten STEM Grading
- 基于大模型实现从扫描稿到评分的全流程自动化批改
- 平均节省65%阅卷时间，高置信度预测与人工评分一致率达95.4%
- 已在20所高校实际应用，覆盖4个主要理工学科
批改手写开放式答题仍是大学理工科大班教学的主要瓶颈。我们推出Pensieve（https://www.pensieve.co），一个基于大语言模型（LLMs）的AI辅助批改平台，可自动转录并评估学生作答，为教师提供符合评分标准的分数、文字转录及置信度评级。与以往仅聚焦于转录或评分标准生成的工具不同，Pensieve在人机协同界面中支持从扫描提交到最终反馈的完整批改流程。该系统已在超过20所院校的真实课程中部署，累计批改30万余份学生作答。我们在计算机科学、数学、物理和化学四个核心理工学科中展示了系统细节与实证结果。结果显示，Pensieve平均减少65%的阅卷时间，且对高置信度预测的评分一致性达95.4%。
原文摘要 · Abstract (English)
Grading handwritten, open-ended responses remains a major bottleneck in large university STEM courses. We introduce Pensieve (https://www.pensieve.co), an AI-assisted grading platform that leverages large language models (LLMs) to transcribe and evaluate student work, providing instructors with rubric-aligned scores, transcriptions, and confidence ratings. Unlike prior tools that focus narrowly on specific tasks like transcription or rubric generation, Pensieve supports the entire grading pipeline-from scanned student submissions to final feedback-within a human-in-the-loop interface. Pensieve has been deployed in real-world courses at over 20 institutions and has graded more than 300,000 student responses. We present system details and empirical results across four core STEM disciplines: Computer Science, Mathematics, Physics, and Chemistry. Our findings show that Pensieve reduces grading time by an average of 65%, while maintaining a 95.4% agreement rate with instructor-assigned grades for high-confidence predictions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。