用非结构化文档增强机器翻译,提升模型跨语言理解能力。
Retrieval-Augmented Machine Translation with Unstructured Knowledge
- 构建首个基于多语言非结构化文档的翻译评测基准RAGtrans。
- 在中英、德英翻译上分别提升1.6-3.1和1.7-2.9 BLEU分数。
- 无需额外标注,通过多任务学习让模型学会利用多语言文档信息。
检索增强生成(RAG)通过引入外部信息来提升大语言模型(LLM)性能。在机器翻译(MT)领域,以往工作主要从成对语料或知识图谱中检索上下文示例或领域知识。然而大量世界知识以非结构化文档形式存在,且跨语言不完全对齐。本文研究使用非结构化文档增强机器翻译的方法。我们构建了RAGtrans,首个用于训练与评估大语言模型检索增强翻译能力的基准数据集,包含169,000个由GPT-4o和人工译者收集的翻译样本,并提供多种语言的文档以补充知识。基于此,我们提出一种多任务训练方法,使模型在翻译时能有效利用多语言文档信息,该方法仅使用现有双语语料构建辅助目标,无需额外标注。大量实验表明,该方法在英中翻译中提升1.6–3.1 BLEU和1.0–2.0 COMET,在英德翻译中提升1.7–2.9 BLEU和2.1–2.7 COMET。同时揭示了当前模型在此任务中的关键挑战。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) introduces additional information to enhance large language models (LLMs). In machine translation (MT), previous work typically retrieves in-context examples from paired MT corpora, or domain-specific knowledge from knowledge graphs, to enhance MT models. However, a large amount of world knowledge is organized in unstructured documents, and might not be fully paired across different languages. In this paper, we study retrieval-augmented MT using unstructured documents. Specifically, we build RAGtrans, the first benchmark to train and evaluate LLMs' retrieval-augmented MT ability. RAGtrans contains 169K MT samples collected via GPT-4o and human translators. Besides, documents from various languages are also provided to supply the knowledge to these samples. Based on RAGtrans, we further propose a multi-task training method to teach LLMs how to use information from multilingual documents during their translation. The method uses existing multilingual corpora to create auxiliary training objectives without additional labeling requirements. Extensive experiments show that the method improves LLMs by 1.6-3.1 BLEU and 1.0-2.0 COMET scores in En-Zh, and 1.7-2.9 BLEU and 2.1-2.7 COMET scores in En-De. We also conclude the critical difficulties that current LLMs face with this task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。