arXiv:2607.21603cs.HCcs.AI2026-07

通过对话与行为分析,揭示中学生协作开发AI聊天机器人的过程规律。

Analyzing Middle School Students' Dialogue and Behaviors during Collaborative AI Chatbot Development Using Ordered Network Analysis

论文配图:Analyzing Middle School Students' Dialogue and Behaviors during Collaborative AI Chatbot Development Using Ordered Network Analysis
图 1 · 摘自论文原文
  • 用有序网络分析法追踪学生对话与开发动作的时序关联。
  • 高质量聊天机器人对应更连贯的解释-测试-优化流程。
  • 反复测试并基于输出调整设计的学生,AI知识掌握更好。

随着人工智能教育成为中小学课程的重要组成部分,设计和开发对话式智能体已成为常见的教学实践。以往研究多关注学习成果或最终AI作品的质量,对协作过程中学习如何发生缺乏深入理解。尽管教育人工智能(AIED)领域长期研究科学、技术、工程与数学(STEM)及计算机教育中的协作学习,但学生在真实AI环境中构建AI系统的新场景,为理解协作机制提供了新契机。本研究聚焦中学生在开发AI聊天机器人过程中的协作互动,采用有序网络分析方法,考察对话与开发行为随时间的组织模式,及其与聊天机器人质量、AI知识获取的关系。结果显示,高质量聊天机器人与更整合的解释-测试-优化序列相关;体现清晰推理并基于输出反复测试与修改的互动模式,也与更强的AI知识掌握正相关。研究为协作式AI开发提供了过程视角,拓展了AIED在人工智能教育中的应用边界。

原文摘要 · Abstract (English)

As Artificial Intelligence (AI) education has become a key component of K-12 curricula, activities such as designing and developing conversational agents are increasingly used as instructional practice. Prior work has primarily examined these activities by focusing on students' learning outcomes or the quality of final AI artifacts, offering limited insight into the collaborative processes through which learning unfolds during AI system development. Although the AIED community has a long history of studying collaborative learning in STEM and Computing education, the emergence of AI learning environments in which students build AI systems presents new opportunities to understand how collaboration unfolds in AI education contexts. Grounded in these foundational works, the current study examines collaborative interaction among middle school students engaged in the design and development of an AI chatbot. Using Ordered Network Analysis of students' dialogue and development actions, we characterize how collaboration is organized over time and how interaction patterns relate to chatbot quality and AI knowledge outcomes. Results reveal that higher-quality chatbots are associated with more integrated sequences linking explanation, testing, and refinement. Interaction patterns involving articulated reasoning and repeated testing and revision in response to chatbot output were also associated with stronger AI knowledge outcomes. These findings provide a process-oriented account of collaborative AI chatbot development and extend AIED research on collaborative learning processes to AI education contexts.

AI教育协作学习对话分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。