arXiv:2501.03462cs.CL2025-01综述被引 3

用自检机制生成更靠谱的英语词汇题干扰项

ISSR: Iterative Selection with Self-Review for Vocabulary Test Distractor Generation

  • 通过大模型自检迭代筛选干扰项,确保唯一正确答案
  • 在台湾大学入学考题上测试,显著减少无效选项
  • 适合语言测评设计者与教育AI研究者参考

词汇习得是第二语言学习的核心,直接影响各项语言能力。标准化考试中的词汇评估尤为关键,试题需准确检验学习者的词义理解与语境运用能力。以往研究尝试生成干扰项以辅助英语词汇题设计,但多依赖词库或预设规则,常导致多个合理选项并存,使题目失效。本文聚焦台湾大学入学考试的英语词汇题,分析学生作答分布以揭示题型特征,为后续研究提供依据。同时,识别出大语言模型在协助教师生成干扰项时的关键局限。为此,提出迭代选择与自检(ISSR)框架,引入新型基于大模型的自检机制,确保干扰项有效且多样化。实验表明,ISSR在生成合理干扰项方面表现优异,自检机制能有效剔除可能使题目失效的选项。

原文摘要 · Abstract (English)

Vocabulary acquisition is essential to second language learning, as it underpins all core language skills. Accurate vocabulary assessment is particularly important in standardized exams, where test items evaluate learners' comprehension and contextual use of words. Previous research has explored methods for generating distractors to aid in the design of English vocabulary tests. However, current approaches often rely on lexical databases or predefined rules, and frequently produce distractors that risk invalidating the question by introducing multiple correct options. In this study, we focus on English vocabulary questions from Taiwan's university entrance exams. We analyze student response distributions to gain insights into the characteristics of these test items and provide a reference for future research. Additionally, we identify key limitations in how large language models (LLMs) support teachers in generating distractors for vocabulary test design. To address these challenges, we propose the iterative selection with self-review (ISSR) framework, which makes use of a novel LLM-based self-review mechanism to ensure that the distractors remain valid while offering diverse options. Experimental results show that ISSR achieves promising performance in generating plausible distractors, and the self-review mechanism effectively filters out distractors that could invalidate the question.

词汇测试大模型应用干扰项生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。