arXiv:2604.03022cs.SIcs.AI2026-04中稿 · the 27th Internati…

定制化AI助教比通用聊天机器人更促发学生深度思考。

Comparing the Impact of Pedagogy-Informed Custom and General-Purpose GAI Chatbots on Students' Science Problem-Solving Processes and Performance Using Heterogeneous Interaction Network Analysis

  • 用苏格拉底式提问设计定制聊天机器人,引导学生自主思考。
  • 使用定制机器人时,学生互动强度和思维多样性显著提升。
  • 适合教育科技研发者与科学教学设计者参考。

问题解决在科学教育中至关重要,生成式AI(GAI)聊天机器人已成为支持学生科学解题的潜力工具。然而,通用聊天机器人(如ChatGPT)常提供直接答案,易导致学生认知卸载。以往研究极少关注专为科学解题设计的定制聊天机器人,也未比较其与通用机器人在解题过程与表现上的差异。本研究基于苏格拉底式提问方法,开发了具教学理念的定制GAI聊天机器人,通过引导性问题支持学生思考。采用被试内平衡设计,48名中学生分别使用定制与通用聊天机器人完成两个科学解题任务,共收集3297条对话并运用异质交互网络分析(HINA)进行分析。结果显示:(1)使用定制机器人时,学生互动强度与认知互动多样性显著更高;(2)学生更倾向于遵循定制机器人的引导进行思考与反思,而更常命令通用机器人执行具体操作;(3)两种条件下学生解题表现(以解答质量评估)无统计学显著差异。本研究揭示定制机器人不易引发认知卸载,反而能增强认知参与,为教育中GAI聊天机器人的设计与整合提供理论与实证依据。

原文摘要 · Abstract (English)

Problem solving plays an essential role in science education, and generative AI (GAI) chatbots have emerged as a promising tool for supporting students' science problem solving. However, general-purpose chatbots (e.g., ChatGPT), which often provide direct, ready-made answers, may lead to students' cognitive offloading. Prior research has rarely focused on custom chatbots for facilitating students' science problem solving, nor has it examined how they differently influence problem-solving processes and performance compared to general-purpose chatbots. To address this gap, we developed a pedagogy-informed custom GAI chatbot grounded in the Socratic questioning method, which supports students by prompting them with guiding questions. This study employed a within-subjects counterbalanced design in which 48 secondary school students used both custom and general-purpose chatbot to complete two science problem-solving tasks. 3297 student-chatbot dialogues were collected and analyzed using Heterogeneous Interaction Network Analysis (HINA). The results showed that: (1) students demonstrated significantly higher interaction intensity and cognitive interaction diversity when using custom chatbot than using general-purpose chatbot; (2) students were more likely to follow custom chatbot's guidance to think and reflect, whereas they tended to request general-purpose chatbot to execute specific commands; and (3) no statistically significant difference was observed in students' problem-solving performance evaluated by solution quality between two chatbot conditions. This study provides novel theoretical insights and empirical evidence that custom chatbots are less likely to induce cognitive offloading and instead foster greater cognitive engagement compared to general-purpose chatbots. This study also offers insights into the design and integration of GAI chatbots in science education.

教育AI认知参与对话系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。