arXiv:2506.11432cs.CLcs.AI2025-06被引 2

用预训练翻译模型打造高效韩语语法纠错系统,性能超大模型。

KoGEC : Korean Grammatical Error Correction with Pre-trained Translation Models

  • 基于NLLB模型微调,用特殊标记区分原句与修正句。
  • 在社交对话数据集上表现优于GPT-4o和HCX-3,尤其均衡纠正各类错误。
  • 提供浏览器插件,适合韩语学习者与内容创作者使用。

本研究提出KoGEC,一个基于预训练翻译模型的韩语语法纠错系统。通过微调NLLB模型,并引入特殊语言标记区分原始与修正句子,对比了其与GPT-4o和HCX-3等大语言模型的性能。实验采用两个社交媒体对话数据集进行训练与测试,评估方法包括BLEU分数及以大语言模型为裁判的错误类型分类。结果表明,微调后的NLLB(KoGEC)在韩语语法纠错任务中超越GPT-4o与HCX-3,且对各类错误纠正更均衡;而大型语言模型则对标点错误关注不足。研究还开发了Chrome扩展以提升可访问性。探索词表扩展以改进模型,但发现反而降低性能。该工作为自然语言处理提供了高效、专用的韩语纠错方案,并验证了紧凑任务模型在特定任务中媲美通用大模型的潜力。

原文摘要 · Abstract (English)

This research introduces KoGEC, a Korean Grammatical Error Correction system using pre\--trained translation models. We fine-tuned NLLB (No Language Left Behind) models for Korean GEC, comparing their performance against large language models like GPT-4 and HCX-3. The study used two social media conversation datasets for training and testing. The NLLB models were fine-tuned using special language tokens to distinguish between original and corrected Korean sentences. Evaluation was done using BLEU scores and an "LLM as judge" method to classify error types. Results showed that the fine-tuned NLLB (KoGEC) models outperformed GPT-4o and HCX-3 in Korean GEC tasks. KoGEC demonstrated a more balanced error correction profile across various error types, whereas the larger LLMs tended to focus less on punctuation errors. We also developed a Chrome extension to make the KoGEC system accessible to users. Finally, we explored token vocabulary expansion to further improve the model but found it to decrease model performance. This research contributes to the field of NLP by providing an efficient, specialized Korean GEC system and a new evaluation method. It also highlights the potential of compact, task-specific models to compete with larger, general-purpose language models in specialized NLP tasks.

语法纠错韩语NLP模型微调轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。