arXiv:2602.09366cs.CL2026-02

仅用单语语料实现跨语言词性标注,无需平行语料

Unsupervised Cross-Lingual Part-of-Speech Tagging with Monolingual Corpora Only

  • 利用无监督机器翻译构建伪平行语料,实现词性标签迁移
  • 在28个语言对上表现接近有平行语料的方法,部分语言超越基准
  • 多源投影校准提升平均1.3%性能,适合低资源语言研究

由于词性标注数据稀缺,现有低资源语言研究多采用无监督方法。其中基于词对齐的词性标签投影方法依赖平行语料,难以应用于多数低资源语言。为此,我们提出一种完全无监督的跨语言词性标注框架,仅依赖单语语料,通过无监督神经机器翻译(UNMT)系统将高资源语言句子翻译至低资源语言,构建伪平行句对。随后,基于词对齐标准流程训练目标语言词性标注器。此外,提出多源投影技术校准目标侧投影标签,提升标注器效果。在涵盖四种源语言(英语、德语、西班牙语、法语)和七种目标语言(阿非利卡语、巴斯克语、芬兰语、印度尼西亚语、立陶宛语、葡萄牙语、土耳其语)的28个语言对上评估,结果表明该方法性能可媲美使用平行语料的基线模型,且在某些语言上更优;多源投影技术进一步提升性能,平均优于先前方法1.3%。

原文摘要 · Abstract (English)

Due to the scarcity of part-of-speech annotated data, existing studies on low-resource languages typically adopt unsupervised approaches for POS tagging. Among these, POS tag projection with word alignment method transfers POS tags from a high-resource source language to a low-resource target language based on parallel corpora, making it particularly suitable for low-resource language settings. However, this approach relies heavily on parallel corpora, which are often unavailable for many low-resource languages. To overcome this limitation, we propose a fully unsupervised cross-lingual part-of-speech(POS) tagging framework that relies solely on monolingual corpora by leveraging unsupervised neural machine translation(UNMT) system. This UNMT system first translates sentences from a high-resource language into a low-resource one, thereby constructing pseudo-parallel sentence pairs. Then, we train a POS tagger for the target language following the standard projection procedure based on word alignments. Moreover, we propose a multi-source projection technique to calibrate the projected POS tags on the target side, enhancing to train a more effective POS tagger. We evaluate our framework on 28 language pairs, covering four source languages (English, German, Spanish and French) and seven target languages (Afrikaans, Basque, Finnis, Indonesian, Lithuanian, Portuguese and Turkish). Experimental results show that our method can achieve performance comparable to the baseline cross-lingual POS tagger with parallel sentence pairs, and even exceeds it for certain target languages. Furthermore, our proposed multi-source projection technique further boosts performance, yielding an average improvement of 1.3% over previous methods.

词性标注跨语言无监督低资源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。