arXiv:2502.09648cs.CLcs.AI2025-02中稿 · SAC 2025被引 2

UKTA为韩语写作评估提供多视角分析,提升准确性与可解释性。

UKTA: Unified Korean Text Analyzer

  • 融合词素分析、词汇特征与评分规则的统一框架
  • 在准确率和加权卡帕系数上超越现有基线
  • 适合需要可解释性反馈的韩语教学与自动评估场景

评估写作质量复杂且耗时,常导致学习者反馈延迟。尽管自动化写作评估工具在英语领域有效,韩语领域的自动评估仍面临多视角分析不足、错误传播及评价可解释性差等挑战。为此,我们提出UKTA(统一韩语文本分析器),一个全面的韩语文本分析与写作评估系统。UKTA提供精准的低层词素分析、中层可解释的关键词汇特征,以及高层透明的基于量规的评分。该方法在准确率和二次加权卡帕系数上均优于现有基线,使UKTA成为领先的多视角韩语文本分析与写作评估工具。

原文摘要 · Abstract (English)

Evaluating writing quality is complex and time-consuming often delaying feedback to learners. While automated writing evaluation tools are effective for English, Korean automated writing evaluation tools face challenges due to their inability to address multi-view analysis, error propagation, and evaluation explainability. To overcome these challenges, we introduce UKTA (Unified Korean Text Analyzer), a comprehensive Korea text analysis and writing evaluation system. UKTA provides accurate low-level morpheme analysis, key lexical features for mid-level explainability, and transparent high-level rubric-based writing scores. Our approach enhances accuracy and quadratic weighted kappa over existing baseline, positioning UKTA as a leading multi-perspective tool for Korean text analysis and writing evaluation.

韩语分析写作评估可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。