通过多视角分析数学教学对话,发现非标准话语同样关键。
Towards Actionable Pedagogical Feedback: A Multi-Perspective Analysis of Mathematics Teaching and Tutoring Dialogue
- 融合话语动作与语篇关系,全面解析对话
- 发现无教学动作话语承担引导与结构功能
- 适合教育AI反馈系统与教师培训研究者
有效的反馈对改进数学教育至关重要,研究者常借助先进自然语言处理模型从多角度分析课堂对话。然而,话语层面分析面临两大挑战:(1)多用途性,即单个话语可能具有多种功能,单一标签无法涵盖;(2)大量话语因不符合领域特定话语动作分类而被排除,导致反馈缺失。为此,我们提出一种多视角话语分析框架,整合领域特定谈话动作、对话行为(采用43标签的扁平化多用途SWBD-MASL标注体系)和语篇关系(应用16种关系的分段语篇表征理论)。该自上而下的分析框架能全面理解含谈话动作及不含谈话动作的语句。该方法应用于两个数学教育数据集:TalkMoves(教学)与SAGA22(辅导)。通过分布词频分析、序列话语动作分析及多视角深度挖掘,我们发现了有意义的话语模式,并揭示了非谈话动作话语的关键作用——它们并非填充语,而是承担引导、认可与结构化课堂对话的重要功能。这些发现强调在人工智能辅助教育系统中融入话语关系与对话行为的重要性,以提升反馈质量并构建更响应式的学习环境。本框架不仅有助于提供人类教师反馈,也可支持开发能有效模拟教师与学生角色的AI代理。
原文摘要 · Abstract (English)
Effective feedback is essential for refining instructional practices in mathematics education, and researchers often turn to advanced natural language processing (NLP) models to analyze classroom dialogues from multiple perspectives. However, utterance-level discourse analysis encounters two primary challenges: (1) multifunctionality, where a single utterance may serve multiple purposes that a single tag cannot capture, and (2) the exclusion of many utterances from domain-specific discourse move classifications, leading to their omission in feedback. To address these challenges, we proposed a multi-perspective discourse analysis that integrates domain-specific talk moves with dialogue act (using the flattened multi-functional SWBD-MASL schema with 43 tags) and discourse relation (applying Segmented Discourse Representation Theory with 16 relations). Our top-down analysis framework enables a comprehensive understanding of utterances that contain talk moves, as well as utterances that do not contain talk moves. This is applied to two mathematics education datasets: TalkMoves (teaching) and SAGA22 (tutoring). Through distributional unigram analysis, sequential talk move analysis, and multi-view deep dive, we discovered meaningful discourse patterns, and revealed the vital role of utterances without talk moves, demonstrating that these utterances, far from being mere fillers, serve crucial functions in guiding, acknowledging, and structuring classroom discourse. These insights underscore the importance of incorporating discourse relations and dialogue acts into AI-assisted education systems to enhance feedback and create more responsive learning environments. Our framework may prove helpful for providing human educator feedback, but also aiding in the development of AI agents that can effectively emulate the roles of both educators and students.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。