arXiv:2505.22293cs.CL2025-05被引 4

用分段提示增强低资源翻译,让大模型更懂语法结构

Compensating for Data with Reasoning: Low-Resource Machine Translation with LLMs

  • 按句法覆盖度拆分输入并检索例句,提升翻译准确性
  • 语法覆盖度越高,翻译质量越好,强推理模型表现更优
  • 适合低资源语言互译,尤其对无平行语料场景有效

大型语言模型在多语言机器翻译中展现出强大能力,甚至超越传统神经系统。但以往研究指出,使用大模型进行低资源语言翻译时,提示工程面临挑战。本文提出一种新型上下文学习方法——分段提示(Fragment-Shot Prompting),通过基于句法覆盖率的输入分割与例句检索实现高效翻译;并进一步提出扩展方法Pivoted Fragment-Shot,可在无直接平行数据情况下完成翻译。我们在意大利语与两种拉定语变体之间,使用GPT-3.5、GPT-4o、o1-mini、LLaMA-3.3和DeepSeek-R1进行评估,发现:(1) 分段提示对目标语言及两者间翻译均有效,句法覆盖率与翻译质量呈正相关;(2) 推理能力强的模型能更好利用检索知识,普遍生成更优翻译,且使Pivoted Fragment-Shot显著提升拉定语变体间的翻译效果;(3) 当从低资源语言翻译至高资源语言时,提示工程几乎无法带来提升,零样本提示已达到满意效果。代码与检索语料库已公开。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated strong capabilities in multilingual machine translation, sometimes even outperforming traditional neural systems. However, previous research has highlighted the challenges of using LLMs, particularly with prompt engineering, for low-resource languages. In this work, we introduce Fragment-Shot Prompting, a novel in-context learning method that segments input and retrieves translation examples based on syntactic coverage, along with Pivoted Fragment-Shot, an extension that enables translation without direct parallel data. We evaluate these methods using GPT-3.5, GPT-4o, o1-mini, LLaMA-3.3, and DeepSeek-R1 for translation between Italian and two Ladin variants, revealing three key findings: (1) Fragment-Shot Prompting is effective for translating into and between the studied low-resource languages, with syntactic coverage positively correlating with translation quality; (2) Models with stronger reasoning abilities make more effective use of retrieved knowledge, generally produce better translations, and enable Pivoted Fragment-Shot to significantly improve translation quality between the Ladin variants; and (3) prompt engineering offers limited, if any, improvements when translating from a low-resource to a high-resource language, where zero-shot prompting already yields satisfactory results. We publicly release our code and the retrieval corpora.

低资源翻译大模型提示工程句法覆盖

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。