构建韩语形态标注体系,提出新型评估算法,提升语言模型性能与评测可靠性。
Foundations and Evaluations in NLP
- 基于词素的韩语标注方案,覆盖形态到语义层次
- 在词性标注、依存句法分析等任务上达到领先水平
- 提出jp-algorithm算法,支持端到端灵活评估
本文回顾了自然语言处理(NLP)中两个核心问题:语言资源构建与系统性能评估。过去十年中,作者致力于构建韩语的词素级标注体系,该体系从形态到语义全面捕捉语言特征,在词性标注、依存句法分析和命名实体识别等多项任务中均取得领先结果。同时,研究深入分析了分词粒度对NLP系统性能的关键影响。在评估方面,提出jp-algorithm这一基于对齐的新框架,解决了传统方法在分词和句子边界检测等预处理任务中要求输出与标准答案完全一致的局限。该算法通过线性时间对齐机制,在保持传统评估指标复杂性的同时显著提升评估的准确性和灵活性,为多种端到端NLP系统提供可靠评测工具。研究成果不仅深化了对韩语等形态丰富语言的处理理解,也为多语言资源建设和系统评估提供了可推广的方法论基础。
原文摘要 · Abstract (English)
This memoir explores two fundamental aspects of Natural Language Processing (NLP): the creation of linguistic resources and the evaluation of NLP system performance. Over the past decade, my work has focused on developing a morpheme-based annotation scheme for the Korean language that captures linguistic properties from morphology to semantics. This approach has achieved state-of-the-art results in various NLP tasks, including part-of-speech tagging, dependency parsing, and named entity recognition. Additionally, this work provides a comprehensive analysis of segmentation granularity and its critical impact on NLP system performance. In parallel with linguistic resource development, I have proposed a novel evaluation framework, the jp-algorithm, which introduces an alignment-based method to address challenges in preprocessing tasks like tokenization and sentence boundary detection (SBD). Traditional evaluation methods assume identical tokenization and sentence lengths between gold standards and system outputs, limiting their applicability to real-world data. The jp-algorithm overcomes these limitations, enabling robust end-to-end evaluations across a variety of NLP tasks. It enhances accuracy and flexibility by incorporating linear-time alignment while preserving the complexity of traditional evaluation metrics. This memoir provides key insights into the processing of morphologically rich languages, such as Korean, while offering a generalizable framework for evaluating diverse end-to-end NLP systems. My contributions lay the foundation for future developments, with broader implications for multilingual resource development and system evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。