AI可高效批改化学手写作业，但数值与绘图题仍需人工审核。
Assisting the Grading of a Handwritten General Chemistry Exam with Artificial Intelligence
- 将手写试卷转为图像输入AI，支持反应式、问答、作图等多类型题型
- 文本与反应式题型评分与人工评分高度一致，数值与图形题偏差较大
- 适合用于日常测验批改，但需人工把关以保障公平可信
本文研究基于人工智能的评分系统在手写普通化学考试中的有效性与可靠性，对比了AI与人工评分在各类题型上的表现。考试页面及评分标准以图像形式上传，涵盖化学反应方程式、简答与长答、数值与符号推导、绘图与铅笔草图等纸笔题型。通过线性回归分析与心理测量评估发现，AI在文本与化学反应题上与人工评分高度一致，但在数值计算与图形类任务中可靠性较低。研究强调需通过选择性过滤实现人工监督以确保评分准确性。结果表明AI在常规评估任务中具有应用前景，但须关注学生对公平性与信任度的感知，审慎推进其在教育实践中的整合。
原文摘要 · Abstract (English)
We explore the effectiveness and reliability of an artificial intelligence (AI)-based grading system for a handwritten general chemistry exam, comparing AI-assigned scores to human grading across various types of questions. Exam pages and grading rubrics were uploaded as images to account for chemical reaction equations, short and long open-ended answers, numerical and symbolic answer derivations, drawing, and sketching in pencil-and-paper format. Using linear regression analyses and psychometric evaluations, the investigation reveals high agreement between AI and human graders for textual and chemical reaction questions, while highlighting lower reliability for numerical and graphical tasks. The findings emphasize the necessity for human oversight to ensure grading accuracy, based on selective filtering. The results indicate promising applications for AI in routine assessment tasks, though careful consideration must be given to student perceptions of fairness and trust in integrating AI-based grading into educational practice.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。