arXiv:2608.01922cs.CL2026-08

让模型记住推理过程中的关键结论,提升长链条思维的准确性。

TRAM: Enhancing Multimodal Reasoning with Trajectory-Derived Auxiliary Memory

论文配图:TRAM: Enhancing Multimodal Reasoning with Trajectory-Derived Auxiliary Memory
图 1 · 摘自论文原文
  • 用模型自身推理轨迹生成辅助记忆,不需额外训练
  • 在8个基准上显著提升数学与科学类视觉推理表现
  • 适合需要长期逻辑推理的多模态任务研究者

多模态大推理模型(MLRMs)在需要视觉理解与多步推理的任务中表现优异。然而,随着推理轨迹变长,模型可能无法有效利用早期上下文信息,增加推理错误风险。现有方法主要通过保持视觉锚定来缓解问题,但推理过程中产生的任务特定关系、约束和中间结论在长轨迹中会逐渐弱化。我们的归因分析表明,正确性并非仅由图像相关性决定,更取决于推理轨迹是否持续保留并整合这些推理衍生信息。为此,我们提出TRAM(TRajectory-derived Auxiliary Memory),一种无需训练的方法,通过模型自身推理轨迹生成辅助记忆路径。TRAM将已完成推理凝聚为紧凑潜在记忆,通过快速与慢速循环流在线更新,并通过轻量残差路径反馈至选定解码层。在四种MLRM变体上对八个基准的实验显示,TRAM在不增加训练成本的情况下,显著提升了数学、科学及通用视觉推理任务的表现。

原文摘要 · Abstract (English)

Multimodal Large Reasoning Models (MLRMs) have achieved strong performance on tasks requiring visual understanding and multi-step inference. However, as reasoning trajectories grow, models may become less effective at using information established earlier in the context, increasing the risk of reasoning errors. Existing approaches primarily address this problem by sustaining visual grounding throughout reasoning. However, reasoning also transforms visual observations into task-specific relations, constraints, and intermediate conclusions whose influence may weaken over long trajectories. Our attribution analysis suggests that correctness is not consistently separated by image attribution alone, but is more closely associated with whether trajectories retain and integrate such reasoning-derived information across stages. Motivated by this, we introduce TRAM (TRajectory-derived Auxiliary Memory), a training-free method that augments standard decoding with an auxiliary memory pathway derived from the model's own reasoning trajectory. TRAM consolidates completed reasoning into a compact latent memory, updates it online through fast and slow recurrent streams, and feeds it back into selected decoder layers through a lightweight residual pathway. Experiments across four MLRM variants on eight benchmarks show that TRAM improves performance over vanilla decoding on mathematical, scientific, and general visual reasoning tasks without additional training.

多模态推理记忆机制长链思维无训练优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。