arXiv:2509.13237cs.LGcs.AI2025-09被引 30

让大模型把重复的推理过程提炼成可复用的简短行为,提升推理效率和准确率。

Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors

  • 通过元认知分析将重复推理转为可调用的行为片段
  • 推理令牌减少最高达46%,准确率不降反升
  • 适合追求高效推理与低延迟的应用场景

大语言模型解决多步问题时,常重复推导相同中间步骤,导致令牌使用量和延迟增加,压缩上下文窗口可用空间。本文提出一种机制:通过模型自身对历史推理轨迹的元认知分析,将重复推理片段转化为简洁可复用的“行为”(名称+指令),存入“行为手册”。这些行为可在推理时以提示形式注入,或通过监督微调融入参数。三种设置下均表现优异:1)行为条件推理中,推理令牌减少最多46%,准确率持平或更高;2)行为引导自我改进无需参数更新,准确率比基础批判-重写方法高出最多10%;3)行为条件微调相比普通微调,更有效将非推理模型转化为推理模型。结果表明,将缓慢推导转为快速程序化提示,使模型不仅记住结论,也记住如何推理。

原文摘要 · Abstract (English)

Large language models (LLMs) now solve multi-step problems by emitting extended chains of thought. During the process, they often re-derive the same intermediate steps across problems, inflating token usage and latency. This saturation of the context window leaves less capacity for exploration. We study a simple mechanism that converts recurring reasoning fragments into concise, reusable "behaviors" (name + instruction) via the model's own metacognitive analysis of prior traces. These behaviors are stored in a "behavior handbook" which supplies them to the model in-context at inference or distills them into parameters via supervised fine-tuning. This approach achieves improved test-time reasoning across three different settings - 1) Behavior-conditioned inference: Providing the LLM relevant behaviors in-context during reasoning reduces number of reasoning tokens by up to 46% while matching or improving baseline accuracy; 2) Behavior-guided self-improvement: Without any parameter updates, the model improves its own future reasoning by leveraging behaviors from its own past problem solving attempts. This yields up to 10% higher accuracy than a naive critique-and-revise baseline; and 3) Behavior-conditioned SFT: SFT on behavior-conditioned reasoning traces is more effective at converting non-reasoning models into reasoning models as compared to vanilla SFT. Together, these results indicate that turning slow derivations into fast procedural hints enables LLMs to remember how to reason, not just what to conclude.

大模型推理行为复用元认知效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。