arXiv:2504.03975cs.LGcs.AI2025-04ACL被引 3

开源工具统一优化提示词,适配大小模型,提升生成效果。

GREATERPROMPT: A Unified, Customizable, and High-Performing Open-Source Toolkit for Prompt Optimization

  • 融合文本反馈与梯度优化,适配不同规模模型
  • 支持自定义配置,生成高质量提示词,提升任务表现
  • 提供网页界面,非专业用户也能轻松使用

大语言模型在各类任务中表现出色,但其性能高度依赖输入提示的质量与结构,提示设计成为关键因素。近年来自动化提示优化技术不断发展,能自动提升提示以更好匹配用户期望。然而现有方法普遍存在标准不一、兼容性差、定制化不足、跨模型性能不稳定,且多依赖昂贵的专有API。为此,我们提出GREATERPROMPT,一个统一、可定制、高性能的开源提示优化框架。该框架通过结合基于文本反馈的优化(适用于大模型)和基于内部梯度的优化(适用于小模型),灵活适配不同规模模型,实现高效精准的提示改进。同时提供友好的网页界面,降低使用门槛,促进各类用户和场景的广泛采用。GREATERPROMPT 已通过 GitHub、PyPI 及 Web 界面开放获取。

原文摘要 · Abstract (English)

LLMs have gained immense popularity among researchers and the general public for its impressive capabilities on a variety of tasks. Notably, the efficacy of LLMs remains significantly dependent on the quality and structure of the input prompts, making prompt design a critical factor for their performance. Recent advancements in automated prompt optimization have introduced diverse techniques that automatically enhance prompts to better align model outputs with user expectations. However, these methods often suffer from the lack of standardization and compatibility across different techniques, limited flexibility in customization, inconsistent performance across model scales, and they often exclusively rely on expensive proprietary LLM APIs. To fill in this gap, we introduce GREATERPROMPT, a novel framework that democratizes prompt optimization by unifying diverse methods under a unified, customizable API while delivering highly effective prompts for different tasks. Our framework flexibly accommodates various model scales by leveraging both text feedback-based optimization for larger LLMs and internal gradient-based optimization for smaller models to achieve powerful and precise prompt improvements. Moreover, we provide a user-friendly Web UI that ensures accessibility for non-expert users, enabling broader adoption and enhanced performance across various user groups and application scenarios. GREATERPROMPT is available at https://github.com/psunlpgroup/GreaterPrompt via GitHub, PyPI, and web user interfaces.

提示优化开源工具LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。