arXiv:2605.28224cs.AI2026-05

探究记忆机制在多路径推理中的作用,发现效果依赖于具体推理策略。

When Does Memory Help Multi-Trajectory Inference for Tool-Use LLM Agents?

  • 将记忆机制拆解为传递范围与抽象层次,构建统一评估框架。
  • 同一记忆方法在不同策略下表现差异显著,如反思仅在MCTS中有效。
  • 原子事实提取虽不提升准确率,但可缩短19%-26%的推理路径。

针对工具使用型大模型代理的多路径推理,通过生成多个推理路径并择优选择,可借助跨路径知识迁移避免早期错误。现有跨路径记忆方法(轨迹级反思、原子事实提取、原始观测注入)均在单一推理策略与任务上评估,难以区分性能提升是源于记忆抽象本身还是推理方法。本文提出统一框架,从传递范围(单次扩展内 vs. 跨轨迹)与内容抽象两个维度分解记忆机制,并在三种推理策略(best-of-N、束搜索、MCTS)下,于四个涵盖SQL、知识图谱与命令行环境的工具使用基准上进行验证,采用无验证器设置以匹配实际部署场景。实验表明,推理策略是关键混淆因素:相同记忆方法在不同策略下结果显著不同。反思仅在MCTS中显著有效;同代注入(基于前序候选结果条件化)仅对多样性受限的束搜索有帮助;原子事实提取不影响准确率,但在具有可复用环境结构的任务中使路径长度减少19%-26%。

原文摘要 · Abstract (English)

Multi-trajectory inference for tool-use LLM agents - generating multiple reasoning attempts and selecting among them - benefits from transferring knowledge across attempts so that later ones avoid the pitfalls of earlier ones. Existing cross-trajectory memory methods (trajectory-level reflection, atomic fact extraction, raw observation injection) are each evaluated under a single inference strategy on a single task, making it unclear whether reported gains reflect properties of the memory abstraction or of the inference method. We propose a unified framework that decomposes memory along two axes -- the scope of transfer (within an expansion vs. across trajectories) and the abstraction of the transferred content -- and evaluate four methods under three inference strategies (best-of-N, beam search, MCTS) on four tool-use benchmarks spanning SQL, knowledge-graph, and CLI environments, in a verifier-free setting that matches the deployment regime of practical agents. The experiment matrix identifies the inference method as a confound: the same memory method produces statistically distinct results under different inference strategies on the same examples. Reflection reaches significance only under MCTS (not under best-of-N); within-expansion injection (conditioning each candidate on prior siblings' outcomes) helps only diversity-starved beam search; and atomic fact extraction is accuracy-neutral but shortens trajectories by 19-26% on tasks with reusable environmental structure.

大模型推理记忆机制工具使用多路径优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。