arXiv:2503.04328cs.CLcs.AI2025-03

用词典例句生成数据,让小语种词义消歧更准

Solving Word-Sense Disambiguation and Word-Sense Induction with Dictionary Examples

  • 用大模型从词典例句构造句子对,解决无现成词义标注的问题
  • 在斯洛文尼亚语上实现词义消歧与词义归纳性能超越现有方法
  • 适合资源匮乏语言的词义分析,尤其适合有词典但无语义库的语言

许多低资源语言缺乏现代基于Transformer的大语言模型所需的大型特定任务数据集。尽管词典等语言资源信息丰富,却很少被利用。本文展示如何通过大语言模型扩展低资源语言的现有语言资源,以解决词义消歧(WSD)和词义归纳(WSI)两大任务。我们通过更易获取的词在上下文中(WiC)任务切入:给定两个句子和一个目标词,判断该词在两句中含义是否不同。实验证明,训练良好的WiC模型能有效区分词义,并可适配至WSD和WSI任务。相比直接预测词义,该方法无需预建的、每义项有足够样本的词义清单,这在低资源语言中极为稀缺。我们成功使用大模型从词典例句生成用于WiC任务的句子对,所构建的模型在WiC、WSD和WSI任务上均优于现有模型。方法在斯洛文尼亚语上验证,其虽有单语词典,但词义资源极有限。

原文摘要 · Abstract (English)

Many less-resourced languages struggle with a lack of large, task-specific datasets that are required for solving relevant tasks with modern transformer-based large language models (LLMs). On the other hand, many linguistic resources, such as dictionaries, are rarely used in this context despite their large information contents. We show how LLMs can be used to extend existing language resources in less-resourced languages for two important tasks: word-sense disambiguation (WSD) and word-sense induction (WSI). We approach the two tasks through the related but much more accessible word-in-context (WiC) task where, given a pair of sentences and a target word, a classification model is tasked with predicting whether the sense of a given word differs between sentences. We demonstrate that a well-trained model for this task can distinguish between different word senses and can be adapted to solve the WSD and WSI tasks. The advantage of using the WiC task, instead of directly predicting senses, is that the WiC task does not need pre-constructed sense inventories with a sufficient number of examples for each sense, which are rarely available in less-resourced languages. We show that sentence pairs for the WiC task can be successfully generated from dictionary examples using LLMs. The resulting prediction models outperform existing models on WiC, WSD, and WSI tasks. We demonstrate our methodology on the Slovene language, where a monolingual dictionary is available, but word-sense resources are tiny.

词义消歧低资源语言大模型应用词典利用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。