arXiv:2606.02054cs.AI2026-06

让AI推理像人一样不断修正思路,提升数学题准确率。

eMoT: evolving Memory-of-Thought via Symbolic Anchoring and Memory Corrosion

论文配图:eMoT: evolving Memory-of-Thought via Symbolic Anchoring and Memory Corrosion
图 1 · 摘自论文原文
  • 把推理过程当可进化记忆,动态保留有效步骤
  • 在24点游戏上达100%准确,比基线高17.6%
  • 小模型也能实现强推理,适合资源受限场景

尽管大语言模型在多步推理任务中表现优异,但其可靠性仍受制于幻觉泛滥和数值计算能力差等问题。根源在于标准模型将推理视为一次性生成过程,而非持续保留与优化的逻辑流程。为此,我们提出eMoT(evolving Memory-of-Thought)框架,将推理轨迹视为动态演化的记忆,而非静态模板。该框架包含三个模块:(i) 内存腐蚀机制,强化高价值推理结构,逐步衰减低频路径;(ii) 符号锚定引擎,利用Python实现确定性计算,如同人类使用计算器;(iii) 一致性驱动优化,使神经推断与符号结果对齐,减少逻辑偏差积累。在多个推理基准测试中,eMoT显著提升准确率与解法一致性。在传统24点任务上达到100%准确率,较基线最高提升17.6%。对GSM8K、ASDiv、SVAMP、MGSM等数学任务的评估也显示稳定增益。即使采用轻量级骨干模型,性能仍优于依赖大规模模型的替代方法,证明性能提升源于推理控制机制而非模型规模。

原文摘要 · Abstract (English)

While Large Language Models (LLMs) achieve impressive performance on multi-step reasoning tasks, their reliability is persistently hindered by critical limitations such as unconstrained hallucinations and poor numerical computation. Fundamentally, these issues arise because standard models treat reasoning as a transient, one-off generation process rather than retaining and refining successful procedural logic. To address these challenges, we propose eMoT (evolving Memory-of-Thought), a unified framework that stabilizes multi-step reasoning by treating reasoning trajectories as dynamic, evolving memories rather than static templates. The framework primarily consists of three interconnected modules: (i) a memory corrosion mechanism that reinforces high-utility reasoning structures while gradually decaying less frequent ones; (ii) a symbolic anchoring engine that utilizes Python for deterministic computation, much like a human uses a calculator; and (iii) a consistency-driven refinement process that aligns neural inference with symbolic outcomes, reducing the accumulation of logical discrepancies. Across multiple reasoning benchmarks, eMoT improves accuracy and solution consistency over standard Chain-of-Thought and structured reasoning baselines.On the traditional task Game of 24, eMoT achieves 100% accuracy, surpassing the baseline by up to 17.6%. Evaluations on mathematical task GSM8K, ASDiv, SVAMP, and MGSM further show consistent gains in multi-step mathematical reasoning. In our evaluation, we achieve superior performance despite utilizing a lightweight backbone model with constrained baseline capabilities. Compared to alternative methods that rely on massively scaled models, our results demonstrate that the performance gains are fundamentally driven by the eMoT framework's reasoning control rather than sheer model size.

推理增强符号融合数学问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。