arXiv:2510.06695cs.CLcs.AI2025-10

小模型通过反向翻译优化输入提示,提升机器翻译效果

Learning to Rewrite Prompts for Bootstrapping LLMs on Downstream Tasks

  • 用小模型基于反向翻译训练,专门优化提示中的输入部分
  • 在机器翻译任务上表现优异,训练开销远低于大模型
  • 方法可扩展至其他下游任务,适合资源受限场景

近年来,大型语言模型(LLMs)的兴起推动了提示工程的发展,从人工设计转向模型驱动的优化。提示通常包含两部分:定义任务目标的指令(instruction)和针对指令类型的输入(input)。在自然语言生成(NLG)任务如机器翻译中,输入部分尤为重要,而指令部分往往较简短。现有提示工程方法主要针对通用任务优化指令部分,常需依赖大参数模型作为辅助工具,但在输入起关键作用的任务(如机器翻译)中适用性有限。为此,本文提出一种专为机器翻译设计的新提示优化方法,采用基于反向翻译策略训练的小参数模型,显著降低单任务优化的训练开销,同时实现高效性能。经适当调整,该方法亦可推广至其他下游任务。

原文摘要 · Abstract (English)

In recent years, the growing interest in Large Language Models (LLMs) has significantly advanced prompt engineering, transitioning from manual design to model-based optimization. Prompts for LLMs generally comprise two components: the \textit{instruction}, which defines the task or objective, and the \textit{input}, which is tailored to the instruction type. In natural language generation (NLG) tasks such as machine translation, the \textit{input} component is particularly critical, while the \textit{instruction} component tends to be concise. Existing prompt engineering methods primarily focus on optimizing the \textit{instruction} component for general tasks, often requiring large-parameter LLMs as auxiliary tools. However, these approaches exhibit limited applicability for tasks like machine translation, where the \textit{input} component plays a more pivotal role. To address this limitation, this paper introduces a novel prompt optimization method specifically designed for machine translation tasks. The proposed approach employs a small-parameter model trained using a back-translation-based strategy, significantly reducing training overhead for single-task optimization while delivering highly effective performance. With certain adaptations, this method can also be extended to other downstream tasks.

提示优化机器翻译小模型反向翻译

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。