arXiv:2511.21714cs.CLcs.AI2025-11被引 3

无需任务微调,为每条输入生成个性化提示,提升大模型性能。

GPS: General Per-Sample Prompter

  • 用强化学习训练通用提示器,按输入动态生成提示。
  • 零样本下在文本简化、摘要等任务上达次优或顶尖表现。
  • 适合希望减少人工调参、提升推理灵活性的研究者。

大语言模型对提示词敏感,性能常受细微措辞影响。现有自动提示方法存在三大局限:需大量数据训练提示、优化耗时长、仅生成通用任务级提示。本文提出GPS——首个通用的、按样本定制提示的方法。无需任务特定微调,即可为每个未见输入生成定制化提示,显著提升多任务性能。提示器通过强化学习在多个训练任务上训练,并引入新正则化机制以适应样本级提示。最后采用最小贝叶斯风险解码稳定推理。实验表明,不依赖任何目标任务训练数据,GPS在文本简化任务中取得第二好结果,在摘要和分类任务中分别获第三和并列最佳;在领域内提示场景下,于GSM8K达到当前最优。该工作展示了生成自适应、输入相关提示的新范式,避免复杂优化与特定数据集依赖。代码已公开于https://github.com/Batorskq/GPS。

原文摘要 · Abstract (English)

LLMs are sensitive to prompting, with task performance often hinging on subtle, sometimes imperceptible variations in phrasing. As a result, crafting effective prompts manually remains challenging and time-consuming. Recent automatic prompting methods mitigate this difficulty but face three key limitations: (i) for each new task, they require large datasets to train good prompts;(ii) they rely on costly optimization loops that may take hours; (iii)they typically produce a single task-level prompt that does not adapt to the individual input problem to be solved. We propose GPS, the first general-purpose, per-sample prompting method. Without any task-specific tuning, GPS generates a tailored prompt for each unseen input, improving performance across diverse tasks. The prompter is trained with reinforcement learning on a suite of training tasks and includes a novel regularization for effectively adapting to per-sample prompting. Finally, we employ Minimum Bayes Risk decoding to stabilize inference. Empirically, GPS demonstrates competitive performance: we attain second best results among baselines on text simplification, third best results on summarization and on-par results on classification, while not training on any of these tasks, in contrast to the baselines. For in-domain prompting, we obtain sota on GSM8K. Our work shows the potential of a novel and effective paradigm for automatic prompting: generating adaptive, input-specific prompts without extensive optimization and without access to a task-specific training set. Our code is available at https://github.com/Batorskq/GPS.

提示工程强化学习零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。