arXiv:2508.08680cs.CL2025-08EMNLP被引 1

用大模型生成多样话题的低资源语言文本,提升机器翻译效果。

TopXGen: Topic-Diverse Parallel Data Generation for Low-Resource Machine Translation

  • 利用大模型在高资源语言上的强翻译能力,生成自然流畅的低资源语言文本。
  • 生成数据在多个低资源语言上表现优异,显著提升微调和上下文学习的翻译性能。
  • 适合需要低成本构建高质量平行语料的低资源语言翻译研究者。

大模型通过上下文学习在高资源语言翻译中表现良好,接近监督模型。但在低资源语言(LRL)上仍存在差距。现有方法如相似性搜索和微调受限于现有平行语料库的规模、质量和多样性。常见做法是合成平行数据,如回译,但需高质量的目标侧文本,这对多数低资源语言不现实。本文提出 extsc{TopXGen},一种基于大模型的多低资源语言高质量、话题多样数据生成方法,可回译为可用于上下文学习和微调的有用平行文本。核心思路是:尽管大模型难以直接翻译到低资源语言,但其在高资源语言上的翻译能力及多语言特性使其能生成自然流畅的目标侧文本,并准确回译至高资源源语言。实验表明, extsc{TopXGen} 显著提升了大模型在微调和上下文学习中的翻译表现。代码与输出已开源。

原文摘要 · Abstract (English)

LLMs have been shown to perform well in machine translation (MT) with the use of in-context learning (ICL), rivaling supervised models when translating into high-resource languages (HRLs). However, they lag behind when translating into low-resource language (LRLs). Example selection via similarity search and supervised fine-tuning help. However the improvements they give are limited by the size, quality and diversity of existing parallel datasets. A common technique in low-resource MT is synthetic parallel data creation, the most frequent of which is backtranslation, whereby existing target-side texts are automatically translated into the source language. However, this assumes the existence of good quality and relevant target-side texts, which are not readily available for many LRLs. In this paper, we present \textsc{TopXGen}, an LLM-based approach for the generation of high quality and topic-diverse data in multiple LRLs, which can then be backtranslated to produce useful and diverse parallel texts for ICL and fine-tuning. Our intuition is that while LLMs struggle to translate into LRLs, their ability to translate well into HRLs and their multilinguality enable them to generate good quality, natural-sounding target-side texts, which can be translated well into a high-resource source language. We show that \textsc{TopXGen} boosts LLM translation performance during fine-tuning and in-context learning. Code and outputs are available at https://github.com/ArmelRandy/topxgen.

机器翻译低资源数据生成大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。