arXiv:2501.15777cs.CL2025-01被引 1

用答案诊断图自动生成阅读理解题反馈,帮学生发现错误并提升学习动机。

Automatic Feedback Generation for Short Answer Questions using Answer Diagnostic Graphs

  • 构建答案诊断图,融合文本逻辑结构与反馈模板,实现精准诊断。
  • 实验显示反馈显著提升学生纠错能力与学习动机,但成绩提升不明显。
  • 适合教育AI、智能辅导系统开发者,尤其关注反馈生成的研究者。

短篇阅读理解题有助于学生理解文本结构,但缺乏有效反馈。学生难以识别和纠正错误,而人工反馈耗时费力。因此亟需自动化反馈系统,将学生作答与评分标准关联,促进深层理解。尽管自然语言处理(NLP)取得进展,研究多集中于自动评分,反馈生成仍较少。为此,我们提出首个针对短答阅读理解的反馈生成系统。该系统基于文本逻辑结构,构建“答案诊断图”,结合NLP技术评估学生理解程度,并生成针对性反馈。我们在日本高中生中开展实验(n=39),学生回答两道70-80词问题后分为两组:一组获得标准答案,另一组获得系统生成反馈。两组均重答题目,比较得分变化。问卷调查评估感知与动机。结果显示,两组得分提升无显著差异,但系统反馈显著帮助学生识别错误和文本关键点,并显著提升学习动机。未来需进一步优化文本结构理解能力。

原文摘要 · Abstract (English)

Short-reading comprehension questions help students understand text structure but lack effective feedback. Students struggle to identify and correct errors, while manual feedback creation is labor-intensive. This highlights the need for automated feedback linking responses to a scoring rubric for deeper comprehension. Despite advances in Natural Language Processing (NLP), research has focused on automatic grading, with limited work on feedback generation. To address this, we propose a system that generates feedback for student responses. Our contributions are twofold. First, we introduce the first system for feedback on short-answer reading comprehension. These answers are derived from the text, requiring structural understanding. We propose an "answer diagnosis graph," integrating the text's logical structure with feedback templates. Using this graph and NLP techniques, we estimate students' comprehension and generate targeted feedback. Second, we evaluate our feedback through an experiment with Japanese high school students (n=39). They answered two 70-80 word questions and were divided into two groups with minimal academic differences. One received a model answer, the other system-generated feedback. Both re-answered the questions, and we compared score changes. A questionnaire assessed perceptions and motivation. Results showed no significant score improvement between groups, but system-generated feedback helped students identify errors and key points in the text. It also significantly increased motivation. However, further refinement is needed to enhance text structure understanding.

教育AI反馈生成阅读理解NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。