用分步引导方式让大模型自动生成推理提示,提升解题质量。
Let's Be Self-generated via Step by Step: A Curriculum Learning Approach to Automated Reasoning with Large Language Models
- 模仿人类学习路径,从简单问题逐步引导复杂推理
- 在多个任务中表现优于现有最优方法,跨模型效果稳定
- 适合需要高质量自动推理的场景,如教育评测与智能助手
尽管思维链(Chain of Thought, CoT)提示方法显著提升了大语言模型(LLM)的推理能力,但仍存在依赖人工或外部数据、难以生成高质量提示等局限。为解决这些问题,我们提出一种名为LBS3的新方法,受课程学习启发,更贴近人类学习模式。LBS3首先引导模型回忆与目标问题相关的由易到难的代理问题;随后采用渐进式策略,利用简单代理问题生成的优质提示来指导求解复杂代理问题,从而提升代理解的质量。在多种推理密集型任务中,使用不同开源与闭源大模型进行的广泛实验表明,LBS3在性能上达到与当前最优基线相当甚至更优的效果。
原文摘要 · Abstract (English)
While Chain of Thought (CoT) prompting approaches have significantly consolidated the reasoning capabilities of large language models (LLMs), they still face limitations that require extensive human effort or have performance needs to be improved. Existing endeavors have focused on bridging these gaps; however, these approaches either hinge on external data and cannot completely eliminate manual effort, or they fall short in effectively directing LLMs to generate high-quality exemplary prompts. To address the said pitfalls, we propose a novel prompt approach for automatic reasoning named \textbf{LBS3}, inspired by curriculum learning which better reflects human learning habits. Specifically, LBS3 initially steers LLMs to recall easy-to-hard proxy queries that are pertinent to the target query. Following this, it invokes a progressive strategy that utilizes exemplary prompts stemmed from easy-proxy queries to direct LLMs in solving hard-proxy queries, enabling the high-quality of the proxy solutions. Finally, our extensive experiments in various reasoning-intensive tasks with varying open- and closed-source LLMs show that LBS3 achieves strongly competitive performance compared to the SOTA baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。