在有限记忆下高效保留关键证据,提升长时序智能体的问答准确率。
EMBER: Efficient Memory via Budgeted Evidence Retention for Long-Horizon Agents

- 通过预查询留存策略,学习性选择保留最相关证据片段。
- 在8192令牌预算下F1达0.3017,超越最强基线近70%。
- 适合需长期记忆且资源受限的智能体系统设计者。
长时序智能体可存储大量历史记录,但未来回答仍需检索、重读和上下文开销。当保留的记忆缺失与答案相关的关键证据时,系统必须回溯更大的原始历史。我们研究了预算化证据留存:在查询未知时,应保留哪些来源证据,以确保其在固定保留证据令牌预算下仍可恢复并使用?我们将此设定实例化为预算化预查询留存,即在数据摄入阶段写入记忆,后续读取时不访问完整原始流。我们提出EMBER,一种学习型留存策略,构建紧凑且源支撑的证据状态。EMBER存储证据胶囊:原文摘录配检索键与更新元数据,保留语义根基与读取时的可访问性。查询后结果反馈训练写入者在摄入-检索-回答链中持续保留有效证据。在LongMemEval-RR(基于LongMemEval的留存证据协议)上,EMBER-14B在8192令牌留存证据对比点达到0.3017 F1,远超最强非EMBER基线的0.1765。在不同留存源证据预算下,EMBER均提升F1、留存召回率与读取召回率,表明长时序记忆依赖于在预算内保留证据,而非重读更大历史。
原文摘要 · Abstract (English)
Long-horizon agents can archive large histories, but future answers still incur retrieval, rereading, and context costs. When retained memory misses answer-relevant evidence, the system must return to larger portions of the raw history. We study budgeted evidence survival: before the query is known, which source evidence should be retained so that it remains recoverable and usable under a fixed retained source-evidence token budget? We instantiate this setting as Budgeted Pre-Query Retention, where memory is written during ingestion and later read without access to the full raw stream. We introduce EMBER, a learned retention policy that constructs a compact, source-backed evidence state. EMBER stores evidence capsules: verbatim source excerpts paired with retrieval keys and update metadata, preserving both grounding and read-time access. Post-query outcome feedback trains the writer to preserve evidence across the ingestion-retrieval-answer chain. On LongMemEval-RR, our LongMemEval-derived retained-evidence protocol, EMBER-14B reaches 0.3017 F1 at the 8192-token retained-evidence comparison point, compared with 0.1765 for the strongest non-EMBER budgeted baseline. Across retained source-evidence budgets, EMBER improves F1, Retain-Recall, and Read-Recall, indicating that long-horizon memory depends on retaining evidence within the budget rather than rereading larger histories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。