提出AI自动评分框架,解决学术评估中政策空白与工具认知不足问题
Auto-assessment of assessment: A conceptual framework towards fulfilling the policy gaps in academic assessment practices
- 构建AI自主评估系统,基于内容理解自动打分
- 71.79%学者认可AI在自主评估中的价值,但多数不熟悉主流AI工具
- 为教师提供可信的AI使用指南,适合教育管理者与一线教师参考
人工智能正快速重塑教育,生成式AI可辅助师生完成重复性任务并提供个性化建议。然而,学生滥用AI进行学术评估引发广泛担忧。当前存在两种对立观点:完全禁止或在严格政策下合理使用。这种矛盾凸显了学术评估领域的政策空白。我们对来自英国、阿联酋和伊拉克的117名学者调查发现,多数学者持积极态度,尤其是资深教师,他们不支持全面禁用。值得注意的是,71.79%受访者认为AI在自主评估中具有显著优势。为此,本文首次提出一种新型AI框架,可自动评估学生作业(如报告、课程论文等)并根据其知识掌握程度与深度理解给出评分。调查还揭示资深教师普遍缺乏对现代AI工具(如ChatGPT)的认知,这一差距亟需弥补以保障教育质量。
原文摘要 · Abstract (English)
Education is being transformed by rapid advances in Artificial Intelligence (AI), including emerging Generative Artificial Intelligence (GAI). Such technology can significantly support academics and students by automating monotonous tasks and making personalised suggestions. However, despite the potential of the technology, there are significant concerns regarding AI misuse, particularly by students in assessments. There are two schools of thought: one advocates for a complete ban on it, while the other views it as a valuable educational tool, provided it is governed by a robust usage policy. This contradiction clearly indicates a major policy gap in academic practices, and new policies are required to uphold academic standards while enabling staff and students to benefit from technological advancements. We surveyed 117 academics from three countries (UK, UAE, and Iraq), and identified that most academics retain positive opinions regarding AI in education. For example, the majority of experienced academics do not favour complete bans, and they see the potential benefits of AI for students, teaching staff, and academic institutions. Importantly, academics specifically identified the particular benefits of AI for autonomous assessment (71.79% of respondents agreed). Therefore, for the first time, we propose a novel AI framework for autonomously evaluating students' work (e.g., reports, coursework, etc.) and automatically assigning grades based on their knowledge and in-depth understanding of the submitted content. The survey results further highlight a significant lack of awareness of modern AI-based tools (e.g., ChatGPT) among experienced academics, a gap that must be addressed to uphold educational standards.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。