arXiv:2410.08130cs.LGcs.CL2024-10被引 4

动态调整提示词,让小模型也能高效推理

Think Beyond Size: Adaptive Prompting for More Effective Reasoning

  • 根据推理过程实时调整提示结构,实现自适应
  • 在GSM8K等数据集上准确率显著提升,逼近GPT-4水平
  • 无需微调,适合资源受限场景下的高效推理

预训练大语言模型凭借其少样本学习能力,在自然语言处理任务中广泛应用。尽管链式思维(CoT)提示已显著提升多步推理性能,但现有方法多依赖静态提示模板,无法随任务复杂度或错误动态调整。本文提出自适应提示(Adaptive Prompting),一种动态迭代框架,通过实时调整提示结构与中间验证机制,增强推理能力。实验表明,该方法在算术推理(GSM8K、MultiArith)、逻辑与常识任务上表现优异,相比静态提示基线有显著准确率提升。通过引导提示、中间验证和自纠错步骤,小模型可达到与GPT-4相当的性能,且无需微调或任务特定训练数据,凸显了迭代推理方法的巨大潜力。

原文摘要 · Abstract (English)

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT) prompting, have significantly advanced multi-step reasoning by introducing step-by-step decomposition, achieving state-of-the-art results on complex reasoning benchmarks. However, these approaches often rely on static prompting templates that do not adapt to task complexity or errors during the reasoning process. In this work, we introduce Adaptive Prompting, a dynamic and iterative framework designed to enhance reasoning by incorporating real-time adjustments to prompt structures and validation mechanisms.Experimental results demonstrate that Adaptive Prompting significantly improves performance on diverse reasoning benchmarks, including arithmetic reasoning (GSM8K, MultiArith), logical reasoning and commonsense tasks, achieving substantial accuracy gains compared to static prompting baselines. By integrating guided prompts, intermediate validation, and self-corrective steps, our approach enables smaller models to achieve competitive performance with larger counterparts, such as GPT-4, while maintaining computational efficiency. The framework achieves this without requiring fine-tuning or task-specific training data, highlighting the untapped potential of iterative reasoning methods.

提示工程推理优化自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。