arXiv:2410.11006cs.CL2024-10NAACL被引 1

无需人工标注,用大模型自动挖掘翻译例句提升低资源翻译效果

Effective Self-Mining of In-Context Examples for Unsupervised Machine Translation with LLMs

  • 先挖词级翻译对,再扩展成句级平行语料
  • 在1500万条候选中筛选出高质量例句,平均提升7 BLEU
  • 适合低资源语言对的无监督机器翻译研究者

大型语言模型在自然语言处理任务中表现出色,主要依赖上下文学习(ICL),即通过提供任务示例使模型生成答案。然而,在低资源或超多语言任务中,这些上下文示例难以获取。本文提出一种无监督方法,从大规模语料中自动挖掘可用于机器翻译的上下文例句,实现跨语言的无监督机器翻译(UMT)。方法首先进行词级挖掘获取词对翻译,再基于这些结果进行句级挖掘。由于挖掘结果可能包含噪声,我们设计了一种过滤机制,从数百万条无监督平行句中选出最优例句。在FLORES-200数据集的288个语言方向上,使用两种多语言LLM进行评估,并分析了多种语言特征对性能的影响。实验表明,该方法能有效挖掘高质量上下文例句,翻译性能达到或超过使用人工标注数据构建的常规ICL样本,且平均优于现有顶尖无监督翻译方法7个BLEU点。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated impressive performance on a wide range of natural language processing (NLP) tasks, primarily through in-context learning (ICL). In ICL, the LLM is provided with examples that represent a given task such that it learns to generate answers for test inputs. However, access to these in-context examples is not guaranteed especially for low-resource or massively multilingual tasks. In this work, we propose an unsupervised approach to mine in-context examples for machine translation (MT), enabling unsupervised MT (UMT) across different languages. Our approach begins with word-level mining to acquire word translations that are then used to perform sentence-level mining. As the quality of mined parallel pairs may not be optimal due to noise or mistakes, we introduce a filtering criterion to select the optimal in-context examples from a pool of unsupervised parallel sentences. We evaluate our approach using two multilingual LLMs on 288 directions from the FLORES-200 dataset and analyze the impact of various linguistic features on performance. Our findings demonstrate the effectiveness of our unsupervised approach in mining in-context examples for MT, leading to better or comparable translation performance as translation with regular in-context samples (extracted from human-annotated data), while also outperforming the other state-of-the-art UMT methods by an average of $7$ BLEU points.

无监督翻译上下文学习自动挖掘大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。