通过模型反馈动态选例,提升大模型推理能力
The Power of Adaptation: Boosting In-Context Learning through Adaptive Prompting
- 根据模型反馈逐次筛选示例,减少知识冗余
- 在多个推理任务上显著提升大模型表现
- 适合需要高效提示设计的智能系统开发者
大型语言模型(LLMs)在多种语言任务中展现出卓越能力,尤其是在解决复杂推理问题时。一种有效提升性能的方法是上下文学习,即通过提供解释性示例引导模型逐步推理。然而,为不同数据集选择合适的示例仍具挑战,因每个数据集需特定示例集才能让模型有效学习并取得良好测试表现。现有研究多采用基于不确定度或多样性的非自适应策略一次性选定示例,但此类方法易导致示例间知识重复,降低整体信息量。为此,我们提出 extsc{Adaptive-Prompt},一种利用先前选定示例的模型反馈进行动态迭代选例的新方法。实验表明,该方法在多个推理任务上显著提升大模型性能。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated exceptional abilities across a broad range of language-related tasks, including generating solutions to complex reasoning problems. An effective technique to enhance LLM performance is in-context learning, which encourages a step-by-step reasoning process by including explanatory examples to guide the model's responses. However, selecting appropriate exemplars for the model poses a challenge, as each dataset demands a distinct set of exemplars to enable the LLM to learn effectively and perform well on the test set. Current studies often rely on uncertainty- or diversity-based selection strategies to select exemplars for annotation and to improve model learning. However, these studies typically employ a non-adaptive approach, selecting a set of exemplars all at once. We argue that this non-adaptive strategy may result in a set of exemplars with high redundancy in terms of the knowledge covered, ultimately reducing their overall informativeness. To address this limitation, we propose \textsc{Adaptive-Prompt}, a novel method that adaptively selects exemplars by leveraging model feedback from previously chosen exemplars. Experimental results show that \textsc{Adaptive-Prompt} significantly enhances LLM performance across a variety of reasoning tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。