用大模型的推理过程预测其判断是否正确,提升教育对话分析的可靠性。
LLM Reasoning Predicts When Models Are Right: Evidence from Coding Classroom Discourse
- 通过分析大模型的推理文本,用词频权重编码并训练分类器判断自身预测对错。
- 随机森林模型在3万条课堂语料上达到F1=0.83,能有效识别多数错误判断。
- 正确推理多用因果词,错误推理更倾向使用可能、认为等模糊表达。
大型语言模型(LLMs)被广泛用于大规模自动标注和分析教育对话,但现有方法缺乏可靠机制检测模型出错情况。本文研究大模型生成的推理是否可用于预测其自身判断的正确性。分析了来自课堂对话的30,300条教师语句,每条均由多个先进大模型标注教学行为并附带推理。基于人工验证的真值标签,任务设定为预测模型对某条语句的标签是否正确。采用词频-逆文档频率(TF-IDF)编码大模型推理,并评估五种监督分类器。随机森林分类器取得F1分数0.83(召回率=0.854),成功识别多数错误预测,优于基线方法。针对特定教学行为构建专用检测器进一步提升了对复杂行为的性能,表明错误检测受益于特定行为的语义线索。利用语言询问与词计数(LIWC)框架分析四种正确性标记:因果性、区分性、不确定性与洞察力。正确预测表现出具体因果语言(如because, therefore),而错误推理更常依赖认知缓释(如might, could)和表现性元认知(如think, realize)。句法复杂度无法区分正误推理,且更长的推理并不更可靠。结果表明,基于推理的错误检测提供了一种实用且可扩展的质量控制方法,适用于自动化教育对话分析。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly deployed to automatically label and analyze educational dialogue at scale, yet current pipelines lack reliable ways to detect when models are wrong. We investigate whether reasoning generated by LLMs can be used to predict the correctness of a model's own predictions. We analyze 30,300 teacher utterances from classroom dialogue, each labeled by multiple state-of-the-art LLMs with an instructional move construct and an accompanying reasoning. Using human-verified ground-truth labels, we frame the task as predicting whether a model's assigned label for a given utterance is correct. We encode LLM reasoning using Term Frequency-Inverse Document Frequency (TF-IDF) and evaluate five supervised classifiers. A Random Forest classifier achieves an F1 score of 0.83 (Recall = 0.854), successfully identifying most incorrect predictions and outperforming baselines. Training specialist detectors for specific instructional move constructs further improves performance on difficult constructs, indicating that error detection benefits from construct-specific linguistic cues. Using the Linguistic Inquiry and Word Count (LIWC) framework, we examine four linguistic markers of correctness: Causation, Differentiation, Tentativeness, and Insight. Correct predictions exhibit grounded causal language (e.g., because, therefore), while incorrect reasoning is substantially more likely to rely on epistemic hedging (e.g., might, could) and performative metacognition (e.g., think, realize). Syntactic complexity does not distinguish correct from incorrect reasoning, and longer reasoning is not more reliable. These findings demonstrate that reasoning-based error detection offers a practical and scalable approach to quality control in automated educational dialogue analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。