让大模型长时记忆可精准调用,避免信息丢失或重算
Addressable Recall Compaction for Long Context-Window Control in AI Agents

- 把历史记录存入可编号的归档日志,旧信息用引用代替
- 在长文本任务中准确率提升至99.4%,优于基线11个百分点
- 适合需要长期记忆和高效推理的AI智能体应用
长周期大模型智能体积累的推理轨迹、操作与工具观测可能超出模型固定上下文窗口。现有压缩方法通过丢弃、摘要或检索早期信息来应对,但可能误删关键内容或无法可靠恢复。本文提出ARC(可寻址回忆压缩)框架,将归档存储与活跃上下文分离:工具观测以追加式、ID可寻址方式存入日志,压缩时用紧凑引用替代旧记录。智能体可使用标识符直接请求存储内容,无需重执行工具或依赖相似性检索。我们在Qwen3-8B(16k上下文)和Qwen3-32B(32k上下文)上评估,针堆测试中平均精确答案准确率达99.40%,高于最佳基线的88.12%;在LongBench-v2 Hard子集上平均准确率为29.97%,优于基线28.25%。结果表明,显式的地址化召回能提升信息保留与服务效率。
原文摘要 · Abstract (English)
Long-horizon LLM agents accumulate reasoning traces, actions, and tool observations that can eventually exceed a model's fixed context window. Existing compaction methods address this limitation by discarding, summarizing, or retrieving earlier information, but they may remove task-critical details or fail to recover them reliably. We propose ARC (Addressable Recall Compaction), a context-management framework that separates archival storage from active-context presentation. ARC stores tool observations in an append-only, ID-addressable log and replaces older observations with compact citations when compaction is required. The agent can subsequently use these identifiers to request stored content without re-executing the corresponding tools or depending solely on similarity-based retrieval. We evaluate ARC using Qwen3-8B with a 16k context window and Qwen3-32B with a 32k context window. On the Needle-in-a-Haystack evaluation, ARC achieves an average exact-answer accuracy of 99.40%, compared with 88.12% for the best-performing baseline in our evaluation. ARC also reduces estimated serving time and HBM traffic under our hardware-cost model. On the LongBench-v2 Hard subset, ARC obtains an average accuracy of 29.97%, compared with 28.25% for the best-performing baseline. These results indicate that explicit, address-based recall can improve information retention and serving efficiency relative to the evaluated context-management baselines under the tested settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。