arXiv:2608.02919cs.CL2026-08

用少量示例优化提示词,让大模型表现更稳更强

FLARE: Few-shot Learning-based Adaptive Reflective Engine

  • 基于少样本学习构建自适应反思机制,动态优化提示词
  • 在多个任务上超越现有最优方法,最高提升14.2分
  • 仅需100个验证样本即达最佳效果,稳定性远超对比方法

大型语言模型在复杂AI系统中的表现高度依赖提示质量。尽管当前先进优化器如GEPA(遗传-帕累托)认为反思式指令演化优于传统强化学习与少样本优化,本文提出FLARE(少样本学习驱动的自适应反思引擎),利用先进反思机制和少量参考示例来优化指令。我们在涵盖检索增强推理(HotPotQA、MedQA、2WikiMultiHopQA)、工具调用及多标签情感分类(GoEmotions)的多样化基准上评估该方法,使用GPT-5系列模型。结果表明,FLARE在所有任务-模型组合中均优于GEPA:在HotPotQA上达到52.2分(GEPA为42.2),工具调用准确率达87.0%(GEPA为81.0%),GoEmotions微平均F1提升至52.7%(相较GEPA+15.3,其仅+5.7)。此外,FLARE数据效率极高,在GoEmotions上仅需100个验证样本即可达峰值性能,且在不同随机种子下表现更稳定。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly deployed in complex, compound AI systems where performance hinges on the quality of prompts. Recent state-of-the-art optimizers like GEPA (Genetic-Pareto) have argued that reflective instruction evolution can outperform traditional reinforcement learning and few-shot optimization. In this work, we challenge this shift by introducing FLARE (Few-shot Learning-based Adaptive Reflective Engine), a framework that leverages advanced reflective mechanisms and a small set of few-shot reference examples to optimize instructions. We evaluate our method across a diverse suite of benchmarks -- spanning retrieval-augmented reasoning (HotPotQA, MedQA, 2WikiMultiHopQA), tool calling, and multi-label emotion classification (GoEmotions) -- using the GPT-5 series of models. Our results demonstrate that FLARE consistently outperforms GEPA, winning on every task-model pair: it achieves gains of up to +14.2 points on HotPotQA (52.2 vs. GEPA's 42.2 with GPT-5-Chat), reaches 87.0% on tool calling (vs. 81.0% for GEPA), and lifts GoEmotions micro-F1 to 52.7% (+15.3) with GPT-5.1 on the full 5408-example test split, more than doubling GEPA's +5.7 gain. Beyond raw accuracy, FLARE is also strikingly data-efficient: on GoEmotions it reaches its peak performance using as few as 100 validation examples, while remaining markedly more stable across random seeds than GEPA. Our findings suggest that while reflective instructions are powerful, the strategic optimization of few-shot learning remains a critical frontier for maximizing the potential of next-generation LLMs.

少样本学习提示优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。