arXiv:2505.02576cs.AIcs.LG2025-05被引 5

提出递归分解方法,无需额外示例即可高效解决复杂推理问题。

Recursive Decomposition with Dependencies for Generic Divide-and-Conquer Reasoning

  • 通过递归分解与依赖管理,将复杂推理拆解为有序子任务。
  • 在六级难度的双基准测试中,性能超越现有方法且计算更高效。
  • 支持错误修复,适合无监督场景下的复杂科学工程推理任务。

推理任务在科学与工程等领域至关重要。尽管大语言模型(LLMs)已采用思维链和从少到多提示等技术取得进展,但这些方法在处理复杂问题时性能与执行时间仍难以扩展,且常需针对每项新任务提供特定示例。本文提出递归分解与依赖(RDD)方法,一种可扩展的分治推理机制,显著降低对任务特定监督的需求。该方法可在缺乏任何任务引导的情况下直接应用于新问题类别。此外,RDD 支持子任务间的依赖关系,实现有序执行,并具备错误恢复机制,可修正先前步骤中的错误。我们在两个包含六级难度的基准上进行评估,涵盖两种上下文设置:有任务示例与无任务示例。结果表明,随着任务复杂度增加,在计算资源匹配条件下,RDD 的表现优于其他方法,且整体计算效率更高。

原文摘要 · Abstract (English)

Reasoning tasks are crucial in many domains, especially in science and engineering. Although large language models (LLMs) have made progress in reasoning tasks using techniques such as chain-of-thought and least-to-most prompting, these approaches still do not effectively scale to complex problems in either their performance or execution time. Moreover, they often require additional supervision for each new task, such as in-context examples. In this work, we introduce Recursive Decomposition with Dependencies (RDD), a scalable divide-and-conquer method for solving reasoning problems that requires less supervision than prior approaches. Our method can be directly applied to a new problem class even in the absence of any task-specific guidance. Furthermore, RDD supports sub-task dependencies, allowing for ordered execution of sub-tasks, as well as an error recovery mechanism that can correct mistakes made in previous steps. We evaluate our approach on two benchmarks with six difficulty levels each and in two in-context settings: one with task-specific examples and one without. Our results demonstrate that RDD outperforms other methods in a compute-matched setting as task complexity increases, while also being more computationally efficient.

推理增强分治策略大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。