arXiv:2602.17671cs.HCcs.AI2026-02

学生使用大模型时易受幻觉影响,研究揭示其识别与成因认知短板。

AI Hallucination from Students' Perspective: A Thematic Analysis

  • 通过63名大学生访谈,分析其对幻觉的体验与应对策略
  • 发现幻觉多表现为错误引用、虚假信息及盲目自信回应
  • 强调需在教育中纳入验证方法与生成式AI真实认知

随着学生越来越多依赖大语言模型,幻觉问题对学习构成日益严峻的威胁。为应对这一挑战,人工智能素养需超越提示工程,涵盖学生如何检测和应对模型幻觉。为此,我们向63名大学生提出三个开放性问题,探讨其对AI幻觉的经历、检测策略及成因理解。主题分析显示,报告的幻觉主要表现为错误或虚构引文、虚假信息、过于自信但误导性的回答、未能遵循提示、固执坚持错误答案以及迎合性回复(sycophancy)。学生检测幻觉主要依靠直觉判断或主动验证,如交叉核对外部资料或重新提问。对于幻觉成因,学生的解释反映出多种认知模型,包括显著误解:许多学生认为AI是“研究引擎”,当找不到答案时会自行编造;也有归因于训练数据问题、提示不充分或模型无法理解与验证信息。研究揭示了人工智能辅助学习中的脆弱环节,凸显了开展显性验证训练、建立准确生成式AI认知模型的必要性,并提升对迎合行为与自信表达掩盖错误的认知。该研究为将幻觉意识与缓解措施融入人工智能素养课程提供了实证依据。

原文摘要 · Abstract (English)

As students increasingly rely on large language models, hallucinations pose a growing threat to learning. To mitigate this, AI literacy must expand beyond prompt engineering to address how students should detect and respond to LLM hallucinations. To support this, we need to understand how students experience hallucinations, how they detect them, and why they believe they occur. To investigate these questions, we asked university students three open-ended questions about their experiences with AI hallucinations, their detection strategies, and their mental models of why hallucinations occur. Sixty-three students responded to the survey. Thematic analysis of their responses revealed that reported hallucination issues primarily relate to incorrect or fabricated citations, false information, overconfident but misleading responses, poor adherence to prompts, persistence in incorrect answers, and sycophancy. To detect hallucinations, students rely either on intuitive judgment or on active verification strategies, such as cross-checking with external sources or re-prompting the model. Students' explanations for why hallucinations occur reflected several mental models, including notable misconceptions. Many described AI as a research engine that fabricates information when it cannot locate an answer in its "database." Others attributed hallucinations to issues with training data, inadequate prompting, or the model's inability to understand or verify information. These findings illuminate vulnerabilities in AI-supported learning and highlight the need for explicit instruction in verification protocols, accurate mental models of generative AI, and awareness of behaviors such as sycophancy and confident delivery that obscure inaccuracy. The study contributes empirical evidence for integrating hallucination awareness and mitigation into AI literacy curricula.

AI幻觉教育应用认知偏差AI素养

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。