用多维度反馈优化生成式提示,提升文本质量。
CriSPO: Multi-Aspect Critique-Suggestion-guided Automatic Prompt Optimization for Text Generation
- 引入批判建议模块,自动发现并对比生成与参考文本的多个方面
- 在摘要和问答任务上实现ROUGE提升3-4%,多指标显著改善
- 适合需要高质量生成结果的研究者和开发者
现有自动提示工程方法多针对判别任务,仅依赖单一指标进行有限反馈。但生成任务需更细致的指导以优化文本多个方面。为此,我们提出多方面批判-建议引导的自动提示优化方法CriSPO。其核心为批判建议模块,可自发发现文本差异维度,比较生成与参考文本,并提供具体的提示修改建议。这些明确的批判与可操作建议引导接收式优化模块进行更大范围的有效搜索。为进一步实现多指标优化,我们引入自动后缀调优(AST)扩展,提升任务提示在多指标下的表现。我们在4个先进大模型上对4个摘要和5个问答数据集进行了评估。实验表明,摘要任务上ROUGE分数提升3-4%,问答任务多种指标均有显著改进。代码已开源。
原文摘要 · Abstract (English)
Existing automatic prompt engineering methods are typically designed for discriminative tasks, where new task prompts are iteratively refined with limited feedback from a single metric reflecting a single aspect. However, these approaches are suboptimal for generative tasks, which require more nuanced guidance beyond a single numeric metric to improve the prompt and optimize multiple aspects of the generated text. To address these challenges, we propose a novel multi-aspect Critique-Suggestion-guided automatic Prompt Optimization (CriSPO) approach. CriSPO introduces a critique-suggestion module as its core component. This module spontaneously discovers aspects, and compares generated and reference texts across these aspects, providing specific suggestions for prompt modification. These clear critiques and actionable suggestions guide a receptive optimizer module to make more substantial changes, exploring a broader and more effective search space. To further improve CriSPO with multi-metric optimization, we introduce an Automatic Suffix Tuning (AST) extension to enhance the performance of task prompts across multiple metrics. We evaluate CriSPO on 4 state-of-the-art LLMs across 4 summarization and 5 QA datasets. Extensive experiments show 3-4% ROUGE score improvement on summarization and substantial improvement of various metrics on QA. Code available at https://github.com/amazon-science/crispo
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。