arXiv:2411.18478cs.CL2024-11被引 53

用抽象推理模式替代具体例子,提升大模型的复杂问题求解能力。

Beyond Examples: High-level Automated Reasoning Paradigm in In-Context Learning via MCTS

  • 基于蒙特卡洛树搜索构建五类原子推理动作,生成高层推理路径。
  • 仅用200个样本即在MATH上达80.6%准确率,超越GPT-4o。
  • 适用于不同规模模型,可无缝集成到后训练方法中。

在上下文学习(ICL)中,大语言模型通过提示和高质量示例完成下游任务。然而传统ICL在复杂推理任务中受限于示例质量与缺乏显式推理引导。为此,我们提出HiAR-ICL——一种将关注点从具体示例转向抽象推理模式的高层自动化推理范式,扩展了ICL中“上下文”的内涵。方法首先定义五类原子推理动作,并利用蒙特卡洛树搜索系统构建高层推理模式。推理时,根据问题特征动态选择合适模式,为模型提供明确推理指引。实验表明,仅使用200个先验样本与Qwen2.5-7B-Instruct,该方法在MATH上达到80.6%准确率,在AMC上达62.5%,优于GPT-4o的77.2%与57.5%。性能在不同模型规模下均有效提升,且跨领域泛化能力强。进一步分析显示,HiAR-ICL可作为即插即用的推理方法,兼容GRPO等后训练技术。代码与数据见https://github.com/jinyangwu/HiARICL。

原文摘要 · Abstract (English)

In-context learning (ICL) enables large language models (LLMs) to perform downstream tasks through advanced prompting and high-quality demonstrations. However, traditional ICL paradigms encounter significant limitations in complex reasoning tasks, stemming primarily from their dependence on example quality and absence of explicit reasoning guidance. To address these challenges, we introduce HiAR-ICL, a **Hi**gh-level **A**utomated **R**easoning paradigm in **ICL** that shifts focus from specific examples to abstract reasoning patterns, thereby extending the conventional concept of "context" in ICL. Our approach begins by defining five atomic reasoning actions, upon which we employ Monte Carlo Tree Search to systematically construct high-level reasoning patterns. During inference, HiAR-ICL dynamically selects appropriate reasoning patterns based on problem attributes, providing explicit guidance for the model's reasoning process. Experiments demonstrate HiAR-ICL's effectiveness and efficiency: utilizing only 200 prior samples with Qwen2.5-7B-Instruct, our method achieves 80.6% accuracy on MATH and 62.5% on AMC, exceeding GPT-4o's 77.2% and 57.5%. Our approach enhances performance across models of varying sizes while generalizing effectively across domains. Further analysis reveals that HiAR-ICL can also serve as a plug-and-play inference method compatible with post-training techniques like GRPO. Code and data are available at https://github.com/jinyangwu/HiARICL.

上下文学习推理增强蒙特卡洛树搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。