arXiv:2602.02414cs.CLcs.LG2026-02被引 2

用大模型从师生对话中自动发现学习误解,提升教学效率。

Misconception Diagnosis From Student-Tutor Dialogue: Generate, Retrieve, Rerank

  • 先生成可能的错误认知,再通过相似度检索候选项。
  • 用另一个大模型重排序,显著提升误解识别准确率。
  • 在真实辅导数据上验证,效果优于主流模型且支持小模型微调。

及时准确识别学生的学习误解对改善学习成效和防止错误累积至关重要,但传统方法高度依赖教师的投入与经验。本文提出一种基于大语言模型(LLM)的新方法,从师生对话中检测误解。首先使用微调后的LLM生成潜在误解,再通过嵌入相似度从生成结果中检索最相关的候选;随后由另一微调模型对候选进行评估与重排序,以提升相关性。我们在真实教育辅导平台的数据上进行了实验,测试了LLaMA、Qwen和Claude等多种基础模型在零样本与微调设置下的表现。结果表明,该方法在预测性能上优于基线模型,且微调能显著提升生成误解的质量,甚至超越部分更大规模的闭源模型。消融实验进一步验证了生成与重排序步骤对提升误解识别质量的关键作用。

原文摘要 · Abstract (English)

Timely and accurate identification of student misconceptions is key to improving learning outcomes and pre-empting the compounding of student errors. However, this task is highly dependent on the effort and intuition of the teacher. In this work, we present a novel approach for detecting misconceptions from student-tutor dialogues using large language models (LLMs). First, we use a fine-tuned LLM to generate plausible misconceptions, and then retrieve the most promising candidates among these using embedding similarity with the input dialogue. These candidates are then assessed and re-ranked by another fine-tuned LLM to improve misconception relevance. Empirically, we evaluate our system on real dialogues from an educational tutoring platform. We consider multiple base LLM models including LLaMA, Qwen and Claude on zero-shot and fine-tuned settings. We find that our approach improves predictive performance over baseline models and that fine-tuning improves both generated misconception quality and can outperform larger closed-source models. Finally, we conduct ablation studies to both validate the importance of our generation and reranking steps on misconception generation quality.

教育AI大模型误解检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。