arXiv:2508.20244cs.AI2025-08AAAI被引 14

研究学生在测验中如何使用ChatGPT,发现多数人依赖度低且难有效学习。

Do Students Rely on AI? Analysis of Student-ChatGPT Conversations from a Field Study

  • 提出四阶段依赖分类法,分析学生用AI的模式与效果
  • 315次对话显示学生普遍依赖弱,且失败后难调整策略
  • 行为指标可预测使用倾向,适合教育AI设计参考

本研究探讨大学生在教育测验中使用生成式AI(ChatGPT-4)的情况,聚焦依赖程度及采纳因素。在ChatGPT刚引入、学生熟悉度有限的背景下,通过跨多门STEM课程的简短测验场景,分析了315次学生与AI的对话。研究提出一种新的四阶段依赖分类法,涵盖AI能力感知、相关性判断、采纳行为及最终答案正确性。结果显示:学生整体依赖度较低,许多人无法有效利用AI学习;负面依赖模式常持续存在,表明初次尝试失败后难以调整策略;某些行为特征能显著预测依赖水平,揭示潜在采纳机制。研究强调教育中伦理化整合AI的重要性,建议加强引导流程,并在界面设计中加入依赖校准机制。该研究为实现认知增值与伦理合规的AI教育应用提供了基础洞见。

原文摘要 · Abstract (English)

This study explores how college students interact with generative AI (ChatGPT-4) during educational quizzes, focusing on reliance and predictors of AI adoption. Conducted at the early stages of ChatGPT implementation, when students had limited familiarity with the tool, this field study analyzed 315 student-AI conversations during a brief, quiz-based scenario across various STEM courses. A novel four-stage reliance taxonomy was introduced to capture students' reliance patterns, distinguishing AI competence, relevance, adoption, and students' final answer correctness. Three findings emerged. First, students exhibited overall low reliance on AI and many of them could not effectively use AI for learning. Second, negative reliance patterns often persisted across interactions, highlighting students' difficulty in effectively shifting strategies after unsuccessful initial experiences. Third, certain behavioral metrics strongly predicted AI reliance, highlighting potential behavioral mechanisms to explain AI adoption. The study's findings underline critical implications for ethical AI integration in education and the broader field. It emphasizes the need for enhanced onboarding processes to improve student's familiarity and effective use of AI tools. Furthermore, AI interfaces should be designed with reliance-calibration mechanisms to enhance appropriate reliance. Ultimately, this research advances understanding of AI reliance dynamics, providing foundational insights for ethically sound and cognitively enriching AI practices.

AI教育用户行为依赖分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。