用集成学习优化大模型提示词,提升准确性和鲁棒性。
ELPO: Ensemble Learning Based Prompt Optimization for Large Language Models
- 通过集成多种生成策略与搜索方法,实现提示词优化
- 在ArSarcasm数据集上F1分数提升7.6%
- 适合需要高精度提示词的复杂任务场景
大语言模型的卓越表现高度依赖精心设计的提示词。然而,人工提示工程耗时费力,成为制约其实际应用的核心瓶颈。这一现象催生了自动提示优化(APO)这一新兴研究方向,近年来发展迅速。现有基于进化算法或试错的方法虽能在一定程度上实现高效精准的提示优化,但大多局限于单一模型或算法,处理复杂任务时性能受限。为此,我们提出一种新型框架ELPO(基于集成学习的提示优化),通过集成学习思想引入投票机制,融合共享生成策略与不同搜索方法,以寻找更优提示词。此外,ELPO创新性地设计了更高效的生成与搜索算法。实验表明,ELPO在多种任务上均优于当前最先进方法,例如在ArSarcasm数据集上将F1分数提升7.6%。
原文摘要 · Abstract (English)
The remarkable performance of Large Language Models (LLMs) highly relies on crafted prompts. However, manual prompt engineering is a laborious process, creating a core bottleneck for practical application of LLMs. This phenomenon has led to the emergence of a new research area known as Automatic Prompt Optimization (APO), which develops rapidly in recent years. Existing APO methods such as those based on evolutionary algorithms or trial-and-error approaches realize an efficient and accurate prompt optimization to some extent. However, those researches focus on a single model or algorithm for the generation strategy and optimization process, which limits their performance when handling complex tasks. To address this, we propose a novel framework called Ensemble Learning based Prompt Optimization (ELPO) to achieve more accurate and robust results. Motivated by the idea of ensemble learning, ELPO conducts voting mechanism and introduces shared generation strategies along with different search methods for searching superior prompts. Moreover, ELPO creatively presents more efficient algorithms for the prompt generation and search process. Experimental results demonstrate that ELPO outperforms state-of-the-art prompt optimization methods across different tasks, e.g., improving F1 score by 7.6 on ArSarcasm dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。