arXiv:2411.17270cs.CL2024-11中稿 · SoICT 2024被引 3

用简化头驱动短语结构语法构建越南语神经解析器,性能达新纪录。

An Attempt to Develop a Neural Parser based on Simplified Head-Driven Phrase Structure Grammar on Vietnamese

  • 基于简化头驱动短语结构语法,用PhoBERT/XLM-RoBERTa重写解析器。
  • 句法解析F-score达82%,依赖解析无标签准确率更高。
  • 提示需语言专家参与越南语树库建设,避免标签偏差。

本文旨在基于简化头驱动短语结构语法(simplified HPSG)开发越南语神经解析器。现有语料库VietTreebank和VnDT中约15%的句法树对不符合简化HPSG规则。为解决此问题,我们随机置换训练集与开发集样本,使其符合简化HPSG规范。在此基础上,将原始Penn Treebank的简化HPSG神经解析器替换为可编码越南语的PhoBERT或XLM-RoBERTa模型,并在修改后的VietTreebank和VnDT上进行实验。大量实验表明,该解析器在使用相同词性标注时,句法解析F-score达到82%,创下新纪录;依赖解析的无标签附着率(UAS)也优于此前研究。然而,其带标签附着率(LAS)较低,可能因仅调整弧顺序而未更改原标签,且未咨询语言学专家。研究结果表明,未来越南语语料库建设应更重视语言学专家参与。

原文摘要 · Abstract (English)

In this paper, we aimed to develop a neural parser for Vietnamese based on simplified Head-Driven Phrase Structure Grammar (HPSG). The existing corpora, VietTreebank and VnDT, had around 15% of constituency and dependency tree pairs that did not adhere to simplified HPSG rules. To attempt to address the issue of the corpora not adhering to simplified HPSG rules, we randomly permuted samples from the training and development sets to make them compliant with simplified HPSG. We then modified the first simplified HPSG Neural Parser for the Penn Treebank by replacing it with the PhoBERT or XLM-RoBERTa models, which can encode Vietnamese texts. We conducted experiments on our modified VietTreebank and VnDT corpora. Our extensive experiments showed that the simplified HPSG Neural Parser achieved a new state-of-the-art F-score of 82% for constituency parsing when using the same predicted part-of-speech (POS) tags as the self-attentive constituency parser. Additionally, it outperformed previous studies in dependency parsing with a higher Unlabeled Attachment Score (UAS). However, our parser obtained lower Labeled Attachment Score (LAS) scores likely due to our focus on arc permutation without changing the original labels, as we did not consult with a linguistic expert. Lastly, the research findings of this paper suggest that simplified HPSG should be given more attention to linguistic expert when developing treebanks for Vietnamese natural language processing.

越南语句法解析神经网络HPSG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。