为理工科评估中AI使用提供分场景决策框架
Positioning Generative Artificial Intelligence in STEM Assessment: When to Require, Scaffold, or Restrict Its Use

- 基于证据中心设计,按任务性质决定禁用、辅助或强制使用AI
- 基础技能考核应限制AI,协作能力培养可要求使用AI
- 适合教育研究者与课程设计者参考,提升评估科学性
生成式人工智能(GenAI)给理工科评估带来治理挑战。无限制使用可能导致任务外包,损害传统评估的有效性;而全面禁止又难以执行,可能迫使学生暗中使用,且无法帮助学生适应日益普及的AI工作环境。本文提出一种以学生为中心的框架,基于证据中心设计(ECD),明确在何种情况下应限制、辅助或要求使用GenAI。该框架通过链接目标能力、证据需求和任务特征,给出具体决策规则:当GenAI威胁对独立能力的构念相关证据时(如基础知识和常规技能),应限制使用;当有限度的AI支持能降低外围负担并保持可解释性时,应采用辅助策略;当目标能力涉及人机协作与AI素养时,则应要求使用AI。以大学物理入门课程为例,展示了不同AI政策下任务的设计方法。该框架有助于在保障学习完整性的同时,培养学生应对人工智能赋能的工作环境。
原文摘要 · Abstract (English)
Generative Artificial Intelligence (GenAI) presents a governance challenge for STEM assessment. Unrestricted access can enable task outsourcing that undermines the validity of traditional assessments, while blanket prohibitions are difficult to enforce, may drive use underground, and do little to prepare students for workplaces where GenAI supported workflows are increasingly common. This paper proposes a student focused framework grounded in Evidence Centered Design (ECD) that specifies when to restrict, scaffold, or require GenAI use in STEM assessment. The framework extends existing AI use taxonomies by providing decision rules that link target constructs, evidence requirements, and task characteristics to governance regimes. Restriction is warranted when GenAI threatens construct relevant evidence for unaided proficiency, particularly for foundational knowledge and routine skills. Scaffolding is appropriate when bounded GenAI support reduces peripheral demands while maintaining interpretability. Requiring GenAI is appropriate when the target construct involves human AI collaboration and AI literacy. Using examples from introductory physics, we illustrate how tasks can be designed under different GenAI use policies. The framework provides guidance for preserving learning integrity while supporting preparation for AI enabled environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。