arXiv:2604.17399cs.AI2026-04ACL被引 1

让大模型学会总结反思,越用越聪明。

Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning

论文配图:Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning
图 1 · 摘自论文原文
  • 将推理过程拆分为思考、监控、控制三角色,生成可追溯的元认知痕迹。
  • 通过多时标更新机制,逐步积累并复用过往反思经验,性能随使用持续提升。
  • 适合研究自进化模型、复杂推理系统的人参考。

大型语言模型(LLMs)已展现出强大的推理能力,现有提升方法逐渐成熟,研究重点转向元推理方向。然而,多数元推理方法仍停留在单次实例层面:仅在当前任务中执行复杂元推理流程,却忽视跨实例间可复用的元推理技能积累,导致重复错误和持续高元认知负担。本文提出元认知巩固(Metacognitive Consolidation)框架,使模型能将过去推理经验转化为可复用的知识,以改进未来的元推理。我们通过划分推理、监控与控制三个角色,生成丰富且可归因的元层次痕迹;再利用分层、多时标更新机制,逐步形成演进的元知识。实验表明,在多个基准测试与主干模型上均取得稳定性能提升,且随着元认知经验积累,表现持续增强。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated strong reasoning capabilities, and as existing approaches for enhancing LLM reasoning continue to mature, increasing attention has shifted toward meta-reasoning as a promising direction for further improvement. However, most existing meta-reasoning methods remain episodic: they focus on executing complex meta-reasoning routines within individual instances, but ignore the accumulation of reusable meta-reasoning skills across instances, leading to recurring failure modes and repeatedly high metacognitive effort. In this paper, we introduce Metacognitive Consolidation, a novel framework in which a model consolidates metacognitive experience from past reasoning episodes into reusable knowledge that improves future meta-reasoning. We instantiate this framework by structuring instance-level problem solving into distinct roles for reasoning, monitoring, and control to generate rich, attributable meta-level traces. These traces are then consolidated through a hierarchical, multi-timescale update mechanism that gradually forms evolving meta-knowledge. Experimental results demonstrate consistent performance gains across benchmarks and backbone models, and show that performance improves as metacognitive experience accumulates over time.

元推理自进化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。