用大模型自动判断教师几何思维水平,提升评估效率。
Automatically Inferring Teachers' Geometric Content Knowledge: A Skills Based Approach

- 基于教育理论构建33个细粒度思维技能词典,指导模型分析
- 结合技能信息的模型在分类任务中准确率显著优于基线
- 适合教育研究者和教师培训系统开发者使用
评估教师的几何内容知识对提升几何教学质量和学生学习效果至关重要,但难以规模化。范希尔模型将几何推理分为五个层级。传统范希尔评估依赖专家对开放回答的手动分析,耗时且成本高,难以大规模实施。本研究提出一种基于大语言模型的自动化方法,用于诊断教师的范希尔推理层级。核心假设是:融入显式技能信息可显著提升分类性能。与数学教育研究者合作,构建了将范希尔层级分解为33个细粒度推理技能的结构化技能词典。通过定制网页平台,31名职前教师解答几何题,产生226份回答。专家研究人员对每份回答标注其范希尔层级及词典中的对应技能。基于该标注数据集,实现两种分类方法:(1)检索增强生成(RAG)和(2)多任务学习(MTL)。每种方法均对比了含技能信息的变体与无技能信息的基线。结果表明,两种方法中,含技能信息的变体在多个评价指标上均显著优于基线。本研究首次实现从开放回答自动识别范希尔层级,提供了一种可扩展、理论基础扎实的教师几何推理评估方法,可支持大规模测评与个性化教师学习系统。
原文摘要 · Abstract (English)
Assessing teachers' geometric content knowledge is essential for geometry instructional quality and student learning, but difficult to scale. The Van Hiele model characterizes geometric reasoning through five hierarchical levels. Traditional Van Hiele assessment relies on manual expert analysis of open-ended responses. This process is time-consuming, costly, and prevents large-scale evaluation. This study develops an automated approach for diagnosing teachers' Van Hiele reasoning levels using large language models grounded in educational theory. Our central hypothesis is that integrating explicit skills information significantly improves Van Hiele classification. In collaboration with mathematics education researchers, we built a structured skills dictionary decomposing the Van Hiele levels into 33 fine-grained reasoning skills. Through a custom web platform, 31 pre-service teachers solved geometry problems, yielding 226 responses. Expert researchers then annotated each response with its Van Hiele level and demonstrated skills from the dictionary. Using this annotated dataset, we implemented two classification approaches: (1) retrieval-augmented generation (RAG) and (2) multi-task learning (MTL). Each approach compared a skills-aware variant incorporating the skills dictionary against a baseline without skills information. Results showed that for both methods, skills-aware variants significantly outperformed baselines across multiple evaluation metrics. This work provides the first automated approach for Van Hiele level classification from open-ended responses. It offers a scalable, theory-grounded method for assessing teachers' geometric reasoning that can enable large-scale evaluation and support adaptive, personalized teacher learning systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。