用AI自动批改葡萄牙语完形填空,精准度超83%。
Avaliação de eficiência na leitura: uma abordagem baseada em PLN
- 融合拼写、语法、语义三重分析,自动评分
- 与人工评分相关性达0.832,表现稳健
- 适合大规模教育评估,可捕捉语言能力差异
完形填空测试因成本低、灵活性高被广泛使用,通过填补文本空白来评估阅读理解能力,需调动多样化的语言资源。然而,传统仅以完全匹配为标准的评分方式,难以识别学生表现中的细微差别。本研究提出一种面向巴西葡萄牙语的完形填空自动化评估模型,结合拼写(编辑距离)、语法(词性标注)和语义(嵌入向量相似度)分析。集成方法表现出色,与人工评分的相关性达到0.832。结果表明,该自动化方法具有鲁棒性,对语言能力差异敏感,适用于需要可扩展性的教育场景。
原文摘要 · Abstract (English)
The cloze test, widely used due to its low cost and flexibility, makes it possible to assess reading comprehension by filling in gaps in texts, requiring the mobilization of diverse linguistic repertoires. However, traditional correction methods, based only on exact answers, limit the identification of nuances in student performance. This study proposes an automated evaluation model for the cloze test in Brazilian Portuguese, integrating orthographic (edit distance), grammatical (POS tagging) and semantic (similarity between embeddings) analyses. The integrated method demonstrated its effectiveness, achieving a high correlation with human evaluation (0.832). The results indicate that the automated approach is robust, sensitive to variations in linguistic repertoire and suitable for educational contexts that require scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。