不靠自省反馈,重试就能提升大模型推理能力。
Are Retrials All You Need? Enhancing Large Language Model Reasoning Without Verbalized Feedback
- 让模型在答错时自动重试,无需自我反思或文字反馈。
- 重试机制在多个任务上超越复杂推理框架,准确率更高。
- 适合追求高效推理、减少计算开销的研究与应用者。
近期大语言模型(LLMs)的发展推动了通用自主代理的兴起,在多个领域复杂推理任务中表现出色。这催生了大量基于提示的推理框架。近期研究聚焦于通过自我评估和口头反馈进行迭代优化的策略,但此类方法需额外计算成本以识别并修正错误,显著增加了开销。本文提出「无反馈重试」机制,允许模型在识别到错误答案后重新尝试求解,无需显式自省或口头反馈,极大简化了优化流程。实验表明,更简单的重试方法常优于复杂的推理框架,暗示复杂策略的收益未必能覆盖其成本。本工作挑战了‘更复杂推理必然更好’的主流假设,揭示简单高效方法同样可实现最优效果。因此,重试是否就是全部所需?
原文摘要 · Abstract (English)
Recent advancements in large language models (LLMs) have catalyzed the development of general-purpose autonomous agents, demonstrating remarkable performance in complex reasoning tasks across various domains. This surge has spurred the evolution of a plethora of prompt-based reasoning frameworks. A recent focus has been on iterative reasoning strategies that refine outputs through self-evaluation and verbalized feedback. However, these strategies require additional computational complexity to enable models to recognize and correct their mistakes, leading to a significant increase in their cost. In this work, we introduce the concept of ``retrials without feedback'', an embarrassingly simple yet powerful mechanism for enhancing reasoning frameworks by allowing LLMs to retry problem-solving attempts upon identifying incorrect answers. Unlike conventional iterative refinement methods, our method does not require explicit self-reflection or verbalized feedback, simplifying the refinement process. Our findings indicate that simpler retrial-based approaches often outperform more sophisticated reasoning frameworks, suggesting that the benefits of complex methods may not always justify their computational costs. By challenging the prevailing assumption that more intricate reasoning strategies inherently lead to better performance, our work offers new insights into how simpler, more efficient approaches can achieve optimal results. So, are retrials all you need?
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。