arXiv:2608.01285cs.LGcs.AI2026-08

让大模型根据记忆充足程度自动决定是否停止推理,兼顾速度与准确率。

Stop When Memory Suffices: Evidence-Conditioned Progressive Execution for LLM Agents

论文配图:Stop When Memory Suffices: Evidence-Conditioned Progressive Execution for LLM Agents
图 1 · 摘自论文原文
  • 基于证据条件的渐进式执行,用轻量路由判断是否提前终止
  • 在AMA-Bench和BEAM上分别提升55.17%和38.77%得分,推理时间减少超25%
  • 适合需要高效长时记忆的智能体任务,如复杂问答与规划

随着大语言模型向持久化与自适应智能发展,长期记忆机制成为关键。现有系统或压缩历史以降低开销,或深度检索以提升覆盖,但前者易丢失时序与因果关系,后者则代价高昂。本文提出Router-Mem,一种证据条件的渐进式执行框架:先用低成本前缀检索证据,再由轻量级充分性路由器判断是否可提前终止,实现单令牌决策。该策略通过证据级监督与理由引导表示蒸馏训练。当证据不足时,复用检索结果扩展记忆块并进行深度分析。在AMA-Bench和BEAM上的实验表明,相比完整记忆执行,其得分分别达55.17%和38.77%,平均推理时间分别减少27.3%和25.5%。

原文摘要 · Abstract (English)

The continued development of LLMs toward persistent and adaptive intelligence increasingly requires long-term memory mechanisms that preserve and reuse information across interactions. Existing memory systems either compress and structure histories for efficient access or perform deep research over broader trajectories. The former lowers online cost but may omit temporal, causal, or cross-step dependencies, while the latter improves evidence coverage at substantial latency and inference cost. This raises a key question: can a memory system achieve strong answer quality while maintaining low online latency? We introduce Router-Mem, an evidence-conditioned progressive execution framework for long-horizon agent memory. Router-Mem first applies a shared low-cost retrieval prefix to obtain evidence. A lightweight sufficiency router then predicts whether the context supports early termination, which enable a single-token decision at inference time. It is trained with evidence-level supervision and rationale-conditioned representation distillation. When evidence is insufficient, Router-Mem reuses retrieval hits to expand memory blocks and perform deeper analysis and aggregation. Experiments on AMA-Bench and BEAM show that Router-Mem achieves 55.17\% and 38.77\% score while reducing average inference time by 27.3\% and 25.5\% compared with full memory execution.

大模型记忆机制推理优化智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。