用大模型动态构建语义空间,优化系统提示词效果。
Embedding by Elicitation: Dynamic Representations for Bayesian Optimization of System Prompts
- 让大模型根据反馈生成可解释的提示词特征空间。
- 在30次评估内达成优于现有方法的平均性能表现。
- 适合需要无标签反馈优化提示词的AI系统设计者。
系统提示词是现代AI系统的核心控制机制,影响对话、任务和用户群体的行为。然而,当反馈仅以聚合指标形式存在时,难以调优提示词。本文研究这种仅有聚合反馈的场景,将其建模为离散可变长度文本的样本受限黑箱优化问题。提出ReElicit框架,基于‘嵌入提取’思想:给定任务描述、已评估提示词及标量得分,大模型主动构建紧凑可解释的特征空间,并将提示词映射其中。利用高斯过程代理模型与采样函数,选择目标特征向量,再由大模型生成并优化为可部署提示词。随着新评估结果到来,动态重构建特征空间以适应历史表现。通过离线基准准确率作为聚合代理指标进行评估:每次提示词仅获得一个标量分数,无逐例标签、错误或批评。在十项提示词优化任务中,总评估预算为30次,ReElicit在所有仅依赖聚合反馈的基线方法中表现最优。结果表明,大模型不仅能生成提示词,还能作为自适应语义表示构建者,助力自然语言产物的贝叶斯优化。
原文摘要 · Abstract (English)
System prompts are a central control mechanism in modern AI systems, shaping behavior across conversations, tasks, and user populations. Yet they are difficult to tune when feedback is available only as aggregate metrics rather than per-example labels, failures, or critiques. We study this aggregate feedback setting as sample-constrained black-box optimization over discrete, variable-length text. We introduce ReElicit, a Bayesian optimization framework based on \emph{embedding by elicitation}. Given a task description, previously evaluated prompts, and scalar scores, an LLM elicits a compact, interpretable feature space and maps prompts into it. Leveraging a probabilistic Gaussian process surrogate, an acquisition function then selects target feature vectors, which the LLM realizes and refines into deployable system prompts. Re-eliciting the feature space as new evaluations arrive lets the representation adapt to the observed prompt-score history. We evaluate the setting using offline benchmark accuracy as a controlled aggregate proxy: the optimizer observes one scalar score per prompt and no per-example labels, errors, or critiques. Across ten system prompt optimization tasks with a 30 total evaluation budget, ReElicit achieves the strongest aggregate performance profile among representative aggregate-only prompt-optimization baselines. These results suggest that LLMs can serve as adaptive semantic representation builders, not only prompt generators, for Bayesian optimization over natural-language artifacts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。