用AI工具设计防抄袭测评,提升学生批判性思维能力。
Beyond Detection: Designing AI-Resilient Assessments with Automated Feedback Tool to Foster Critical Thinking
- 结合布鲁姆分类法与NLP技术评估题目抗AI能力
- 能区分低阶记忆题与高阶思维题,避免AI代劳
- 适合教育者用于构建真实有效的学习评估
生成式AI如ChatGPT的普及引发了对学生学习的担忧,尤其可能削弱批判性思维与创造力。当前的AI文本检测工具效果不佳,易出现误判,且对改写、翻译等操作无能为力,因其仅依赖浅层统计特征而非真正的语义理解。为此,本文提出一种以评估设计为核心的主动应对方案:开发一个基于Python的Web工具,融合布鲁姆分类法与GPT-3.5 Turbo、BERT语义相似度、TF-IDF等NLP技术,分析题目表面特征与语义内容,判断其是否适合由AI完成。该工具可帮助教师识别低阶记忆类任务(如复述、总结)与高阶思维任务(如分析、评价、创造),从而设计更难被AI替代的测评,促进原创性与真实性学习。此框架提供了一种可持续、符合教学逻辑的策略,以维护人工智能时代高等教育的学术标准。
原文摘要 · Abstract (English)
The growing use of generative AI tools like ChatGPT has raised urgent concerns about their impact on student learning, particularly the potential erosion of critical thinking and creativity. As students increasingly turn to these tools to complete assessments, foundational cognitive skills are at risk of being bypassed, challenging the integrity of higher education and the authenticity of student work. Existing AI-generated text detection tools are inadequate; they produce unreliable outputs and are prone to both false positives and false negatives, especially when students apply paraphrasing, translation, or rewording. These systems rely on shallow statistical patterns rather than true contextual or semantic understanding, making them unsuitable as definitive indicators of AI misuse. In response, this research proposes a proactive, AI-resilient solution based on assessment design rather than detection. It introduces a web-based Python tool that integrates Bloom's Taxonomy with advanced natural language processing techniques including GPT-3.5 Turbo, BERT-based semantic similarity, and TF-IDF metrics to evaluate the AI-solvability of assessment tasks. By analyzing surface-level and semantic features, the tool helps educators determine whether a task targets lower-order thinking such as recall and summarization or higher-order skills such as analysis, evaluation, and creation, which are more resistant to AI automation. This framework empowers educators to design cognitively demanding, AI-resistant assessments that promote originality, critical thinking, and fairness. It offers a sustainable, pedagogically sound strategy to foster authentic learning and uphold academic standards in the age of AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。