对比真人与AI tutoring对话,发现后者教学互动更简单单一。
How Real Is AI Tutoring? Comparing Simulated and Human Dialogues in One-on-One Instruction
- 用IRF和ENA分析对话结构,量化对比真实与模拟对话
- 真人对话更长、提问更多,反馈更丰富,认知引导更强
- 适合教育AI研发者和教学设计者参考,提升对话教学性
启发式与支架式师生对话被广泛认为对促进学生高阶思维和深度学习至关重要。然而,当前大语言模型在生成教学性强的互动方面仍存在挑战。本研究系统比较了人工智能模拟与真实人类辅导对话在结构和行为上的差异。采用启动-回应-反馈(IRF)编码方案和知识网络分析(ENA)进行定量分析。结果表明,真人对话在话语长度、提问(I-Q)和一般反馈(F-F)行为上显著优于模拟对话。更重要的是,ENA结果显示二者存在根本性差异:真人对话以‘提问-事实回答-反馈’的教学循环为核心,体现明确的教学引导与学生主导思考;而模拟对话则呈现结构简化与行为趋同,围绕‘解释-简单回应’循环展开,本质上是教师向学生单向传递信息。这些发现揭示了现有AI生成辅导的关键局限,并为设计与评估更具教学有效性的生成式教育对话系统提供了实证依据。
原文摘要 · Abstract (English)
Heuristic and scaffolded teacher-student dialogues are widely regarded as critical for fostering students' higher-order thinking and deep learning. However, large language models (LLMs) currently face challenges in generating pedagogically rich interactions. This study systematically investigates the structural and behavioral differences between AI-simulated and authentic human tutoring dialogues. We conducted a quantitative comparison using an Initiation-Response-Feedback (IRF) coding scheme and Epistemic Network Analysis (ENA). The results show that human dialogues are significantly superior to their AI counterparts in utterance length, as well as in questioning (I-Q) and general feedback (F-F) behaviors. More importantly, ENA results reveal a fundamental divergence in interactional patterns: human dialogues are more cognitively guided and diverse, centered around a "question-factual response-feedback" teaching loop that clearly reflects pedagogical guidance and student-driven thinking; in contrast, simulated dialogues exhibit a pattern of structural simplification and behavioral convergence, revolving around an "explanation-simplistic response" loop that is essentially a simple information transfer between the teacher and student. These findings illuminate key limitations in current AI-generated tutoring and provide empirical guidance for designing and evaluating more pedagogically effective generative educational dialogue systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。