让大模型像人一样灵活切换推理方式,动态构建适合任务的思考框架。
Deep Reasoning in General Purpose Agents via Structured Meta-Cognition

- 用可执行的元推理语言,在推理时动态生成任务专属的思考结构。
- 在四个复杂任务上平均比最强基线提升24.8%,8B模型超越多数32B基线。
- 适合需要深度推理、长期规划和自适应结构的任务场景。
人类解决复杂问题时能灵活切换推理模式:规划、执行、调整目标、通过联想判断模糊点,并对明确子问题使用正式方法。当前大模型代理的推理结构是硬编码的,当任务需要调整结构时便失效。本文提出深度推理——一种推理时构建任务特定结构的元认知方法。该方法用形式化语言将元推理表示为对联想推理、正式计算和递归求解的可执行分解,使分解原则可通过上下文示例引导测试时结构生成。我们实现了通用代理DOLORES,将复杂任务分配到更受控的推理线程中。在多跳推理、长链问答、长上下文聚合和深度研究型信息检索四个难题基准上评估,DOLORES在三种模型规模和两种模型族中均优于所有对比基线,平均提升24.8%。其通过结构化低负载推理线程减少过早终止和幻觉。这一优势甚至能弥补规模差距,8B版本在超过一半设置中超越同家族所有32B基线。结果表明未来代理系统应将推理结构视为可自适应生成的动态过程。
原文摘要 · Abstract (English)
Humans intuitively solve complex problems by flexibly shifting among reasoning modes: they plan, execute, revise intermediate goals, resolve ambiguity through associative judgment, and apply formal procedures to well-specified subproblems. Current LLM agents lack this flexibility, as their scaffolds hard-code such reasoning decisions in advance. These scaffolds are effective when their prescribed structure matches the task, but brittle when solving the task requires adapting the structure of reasoning itself. We introduce Deep Reasoning -- an inference-time approach for constructing task-specific scaffolds through structured meta-reasoning. Deep Reasoning uses a formal language that represents meta-reasoning as executable decompositions over associative inference, formal computation, and recursive subproblem solving, enabling decomposition principles to be encoded as in-context examples that guide test-time scaffold construction. We instantiate this approach in a general-purpose agent (DOLORES) that distributes complex tasks across more controlled reasoning threads. We evaluate it against state-of-the-art scaffolding methods across four hard benchmarks: multi-hop reasoning, long-chain question answering, long-context aggregation, and deep research-style information seeking. DOLORES outperforms all evaluated scaffolds across three model sizes and two model families, improving over the strongest evaluated scaffold baseline by 24.8% on average. DOLORES distributes cognition across structured, lower-load reasoning threads, thereby reducing premature termination and hallucinations. This advantage can even bridge the scaling gap, with an 8B version surpassing all evaluated 32B baselines from the same family in more than half the settings. These results point toward future agentic systems that treat scaffolding as adaptive reasoning, constructing the structure each task requires just-in-time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。