arXiv:2410.01952cs.CL2024-10ICLR被引 1

让大模型学会多种推理方式,提升解题能力。

TypedThinker: Diversify Large Language Model Reasoning with Typed Thinking

  • 根据问题类型预测最合适的推理模式(归纳/类比等)
  • 在逻辑数学任务上提升3.4%至7%准确率
  • 无需大模型知识蒸馏,可嵌入现有系统

大型语言模型在解决复杂问题时展现出强大的推理能力。然而,现有方法主要通过细化思维过程来增强推理,忽视了推理类型的多样性。当前模型多依赖演绎推理,从给定条件逐步推导,限制了问题求解中的探索范围。分析表明,某些问题仅能通过特定推理策略(如归纳、溯因或类比)解决。但引入多样化推理面临两大挑战:识别适合每类问题的推理类型,并在求解中有效应用。为此,我们提出TypedThinker,该方法基于问题特征及其历史表现,预测适宜的推理类型,并提供相应示范以引导大模型采用这些策略。实验结果显示,在多个基准测试中性能显著提升:Mistral 7B 提升3.4%,LLaMA3 8B 提升6.5%,Qwen 2 7B 提升7%。TypedThinker无需从更大模型进行知识蒸馏,可集成至 GPT-4o 等先进系统或 MetaMath 等专用模型中,拓展其推理方式,增强问题解决能力。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated strong reasoning capabilities in solving complex problems. However, current approaches primarily enhance reasoning through the elaboration of thoughts while neglecting the diversity of reasoning types. LLMs typically employ deductive reasoning, proceeding step-by-step from given conditions, which limits their exploration during problem-solving. Our analysis reveals that certain problems are exclusively solvable through specific reasoning strategies like inductive, abductive, or analogical reasoning. However, incorporating diverse reasoning approaches presents two key challenges: identifying the appropriate reasoning type for each problem and exploiting this approach during problem-solving. Therefore, we propose the TypedThinker that predicts suitable reasoning types based on the problem and their previous effectiveness and provides relevant demonstrations to guide LLMs in applying these strategies. Experimental results show significant improvements across multiple benchmarks, with performance gains of 3.4% for Mistral 7B, 6.5% for LLaMA3 8B, and 7% for Qwen 2 7B on logical and mathematical reasoning tasks. TypedThinker enhances LLM reasoning without requiring knowledge distillation from larger models. It can be integrated into more advanced systems like GPT-4o or specialized models like MetaMath to diversify their reasoning approaches and improve their problem-solving capabilities.

大模型推理多策略推理提示工程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。