arXiv:2504.19645cs.CLcs.AI2025-04被引 5

为库尔德语核心方言构建标准化词性标注集,提升其自然语言处理能力。

A Comprehensive Part-of-Speech Tagging to Standardize Central-Kurdish Language: A Research Guide for Kurdish Natural Language Processing Tasks

  • 整合多源研究与专家意见,构建全面统一的库尔德语词性标注体系。
  • 对比通用依赖框架验证,新标注集可更准确地纠正和优化句子结构。
  • 适合从事库尔德语自然语言处理的研究者与开发者使用。

近十年来,自然语言处理(NLP)领域迅速发展,涵盖机器翻译、语音识别、文本生成与推荐等应用,其中词性标注(POS)和命名实体识别(NER)是基础任务。然而,像库尔德语核心方言(CKL)这类低资源语言仍缺乏必要支持,进展缓慢。现有词性标注集在CKL中既不统一也不完整,制约了后续任务。本研究提出一套准确且全面的CKL词性标注集,融合多项研究及库尔德语语言学专家意见,旨在标准化词性标签,支持大规模库尔德语语料标注,并提升机器翻译、文本推荐等任务性能。初步对比通用依赖框架(Universal Dependencies)的评估表明,该标注集能更精准地实现句法校正与语义解析,为库尔德语自然语言处理提供坚实基础。

原文摘要 · Abstract (English)

- The field of natural language processing (NLP) has dramatically expanded within the last decade. Many human-being applications are conducted daily via NLP tasks, starting from machine translation, speech recognition, text generation and recommendations, Part-of-Speech tagging (POS), and Named-Entity Recognition (NER). However, low-resourced languages, such as the Central-Kurdish language (CKL), mainly remain unexamined due to shortage of necessary resources to support their development. The POS tagging task is the base of other NLP tasks; for example, the POS tag set has been used to standardized languages to provide the relationship between words among the sentences, followed by machine translation and text recommendation. Specifically, for the CKL, most of the utilized or provided POS tagsets are neither standardized nor comprehensive. To this end, this study presented an accurate and comprehensive POS tagset for the CKL to provide better performance of the Kurdish NLP tasks. The article also collected most of the POS tags from different studies as well as from Kurdish linguistic experts to standardized part-of-speech tags. The proposed POS tagset is designed to annotate a large CKL corpus and support Kurdish NLP tasks. The initial investigations of this study via comparison with the Universal Dependencies framework for standard languages, show that the proposed POS tagset can streamline or correct sentences more accurately for Kurdish NLP tasks.

词性标注库尔德语低资源语言NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。