让AI自动生成可解释的提示优化指南,提升模型表现与透明度。
iPOE: Interpretable Prompt Optimization via Explanations

- 用AI生成的注释解释自动构建优化指南
- 在4个数据集上性能提升最高达39%
- 适合需要专家知识的复杂任务场景
提示优化常被视为离散搜索问题,旨在寻找高性能且鲁棒的LLM指令。然而,搜索结果往往无法说明具体修改为何带来性能提升,这与人类设计标注指南以提高一致性的方式形成对比。本文提出iPOE,一种基于解释的可解释提示优化方法:通过自动生成或人工提供的注释决策解释,构建一系列可优化的指南,再经删除、添加、打乱、合并等操作进行迭代优化。最终生成的提示包含指导性规则,使LLM决策过程和优化路径透明化,尤其适用于需专业知识的复杂领域。在四个数据集上的实验表明,iPOE相比基线最高提升39%;且LLM生成的解释可替代人工解释。可解释性验证研究显示,人类与LLM对关键指南贡献的判断一致性高达Cohen's kappa 0.65。
原文摘要 · Abstract (English)
Prompt optimization has often been framed as a discrete search problem to find high-performing and robust instructions for an LLM. However, the search result might not make it transparent why and where specific prompt changes lead to performance gains. This is in contrast to how humans are instructed for annotation tasks. Here, researchers carefully design annotation guidelines, leading to enhanced annotation consistency. Our paper aims at joining these two approaches and introduces iPOE, a novel interpretable prompt optimization strategy via explanations. We guide the prompt optimization process by automatically created guidelines from explanations of annotation decisions (either automatically generated or from humans). This set of guidelines is furthermore optimized by as series of operations, including removing, adding, shuffling, and merging. The resulting prompt includes guidelines that instruct the annotation, making the decision process of the LLM and the optimization transparent. It therefore supports also laypeople in the area of prompt optimization, particularly in challenging domains requiring expertise. In our experiments on four datasets, we find that iPOE can improves over the evaluated baselines by up to 39% and LLM explanations can replace human explanations in the proposed method. Moreover, our interpretability validation study demonstrates that humans and LLMs can substantially agree on which guidelines contribute to their annotations, achieving a Cohen's kappa score of up to 0.65.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。