arXiv:2506.02480cs.CL2025-06EMNLP被引 5

通过优化角色扮演提示,让大模型在复杂任务中表现更优。

ORPP: Self-Optimizing Role-playing Prompts to Enhance Language Model Capabilities

  • 限定提示搜索空间为角色扮演场景,激活模型内在能力。
  • 小样本迭代优化生成高质量提示,迁移至其余样本。
  • 可无缝衔接其他提示方法,提升整体效果。

高质量提示对激发大语言模型在复杂任务中的卓越性能至关重要。现有研究虽探索了模型驱动的提示优化策略,但常面临计算开销高或依赖模型强优化能力的问题,限制了广泛应用。为此,本文提出ORPP(优化角色扮演提示)框架,通过优化与生成角色扮演提示来增强模型性能。核心思想是将提示搜索空间限定于角色扮演场景,借助精心设计的高质量提示充分激活模型内在能力。具体而言,ORPP首先对少量训练样本进行迭代优化,生成高质量角色扮演提示;随后利用模型的少样本学习能力,将优化经验迁移至剩余样本,高效生成适用提示。实验结果表明,ORPP不仅在性能上达到甚至超过主流提示优化方法,且展现出优异的“即插即用”能力——多数情况下可与多种提示方法结合,进一步提升其效果。

原文摘要 · Abstract (English)

High-quality prompts are crucial for eliciting outstanding performance from large language models (LLMs) on complex tasks. Existing research has explored model-driven strategies for prompt optimization. However, these methods often suffer from high computational overhead or require strong optimization capabilities from the model itself, which limits their broad applicability.To address these challenges, we propose ORPP (Optimized Role-Playing Prompt),a framework that enhances model performance by optimizing and generating role-playing prompts. The core idea of ORPP is to confine the prompt search space to role-playing scenarios, thereby fully activating the model's intrinsic capabilities through carefully crafted, high-quality role-playing prompts. Specifically, ORPP first performs iterative optimization on a small subset of training samples to generate high-quality role-playing prompts. Then, leveraging the model's few-shot learning capability, it transfers the optimization experience to efficiently generate suitable prompts for the remaining samples.Our experimental results show that ORPP not only matches but in most cases surpasses existing mainstream prompt optimization methods in terms of performance. Notably, ORPP demonstrates superior "plug-and-play" capability. In most cases, it can be integrated with various other prompt methods and further enhance their effectiveness.

提示优化角色扮演大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。