arXiv:2608.05124cs.CLcs.AI2026-08

通过分阶段重用模型推理,提升复杂问题的准确率。

Chained Recursive Language Models for Multi-Iteration Reasoning

论文配图:Chained Recursive Language Models for Multi-Iteration Reasoning
图 1 · 摘自论文原文
  • 同一模型多次调用,每轮从头开始推理,避免错误累积。
  • 在多跳推理任务中,准确率比直接回答提升12.3%。
  • 适合需要纠错、迭代验证的复杂逻辑题,如数学证明或数据提取。

大语言模型在长上下文推理中常受限于单次推理需同时处理上下文、存储中间状态、验证证据并生成最终答案。此类任务若涉及抽取、计数、排序或多跳推理,早期错误极易传播至最终结果。本文提出链式递归语言模型(Chained RLM),一种推理时架构:同一基础模型被反复调用,作为一系列独立推理起点。每轮起点接收原始问题与上下文,但不继承完整对话历史,仅接收简洁文本摘要、纯文本黑板及前序推理留下的任务特定成果。该设计通过拆解任务而非一次完成大推理来管理上下文;每阶段计算中,中间成果可被后续新推理检查、修正与扩展。我们描述系统模型、传递机制、成果工作区及评估协议,并研究在何种条件下,以新上下文延续成果的方式,在准确性上显著优于直接调用模型,甚至优于递归工具调用。

原文摘要 · Abstract (English)

Long context reasoning in large language models (LLMs) is usually constrained by the fact that a single inference trajectory has to simultaneously explore the context, store intermediate state, verify evidence, and produce the final answer. This becomes particularly difficult in tasks that require extraction, counting, ordering, or multi-hop reasoning, where an early mistake can propagate until the final response. In this work, we propose Chained Recursive Language Models (Chained RLM), an inference-time architecture, in which the same underlying model is called repeatedly as a sequence of fresh reasoning roots. Each root receives the original problem and context, but does not inherit the full conversational history. Instead, it receives a compact plain-text summary, a plain-text blackboard, and some durable task-specific artifacts written by predecessor roots. The motivation is to manage the context by chopping into partial tasks rather than one large inference response; in each staged computation, intermediate artifacts can be inspected, corrected, and extended by a later fresh inference by the same model. We describe the system model, handoff mechanism, artifact workspace, and evaluation protocol for this system. We study when fresh-context artifact continuation gives a measurable gain in accuracy over direct LLM answering even with recursive tool-calling.

推理增强多步推理模型复用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。