arXiv:2606.05182cs.CLcs.IR2026-06

LANTERN让大模型对话记住更多细节,只需25毫秒延迟

LANTERN: Layered Archival and Temporal Episodic Retrieval Network for Long-Context LLM Conversations

  • 分层记忆网络主动存下每轮对话,用混合检索恢复被压缩的细节
  • 在94个真实对话中找回78.3%丢失的事实,比现有方法提升5.9个百分点
  • 无需调用大模型即可实现,适合部署在低延迟要求的生产系统

大型语言模型在将对话历史压缩以适应有限上下文窗口时会丢弃关键细节。我们提出LANTERN(分层归档与时间性情景检索网络),一种轻量级记忆层,可主动归档每轮对话并通过对齐式检索恢复相关细节,全程不需调用大模型,每轮增加延迟少于25毫秒。在94个真实多轮对话(共1,894条验证事实,人工评估一致性kappa=0.81)上,LANTERN-Rerank恢复了78.3%因压缩丢失的可验证事实,显著优于忠实复现MemGPT的基于大模型提取与多查询搜索的管道(72.4%;威尔科克森检验p<0.0001,95%置信区间[+3.1, +8.6]百分点,效应量d=0.43),且推理成本仅为一小部分。即使不使用重排序器,基础版LANTERN也达到或超过该大模型基线(p=0.005)。当四款生产级大模型使用经LANTERN恢复的上下文回答事实型问题时,平均准确率提升8.4个百分点(每模型单独检验均显著,p<0.05),证明恢复上下文对多种架构均有实际价值。我们公开完整评估框架——配对显著性检验、失败分析、事实类型分层与压缩鲁棒性分析,支持可复现性与后续研究。

原文摘要 · Abstract (English)

Large language models discard critical details when conversation history is compacted to fit within finite context windows. We present LANTERN (Layered Archival aNd Temporal Episodic Retrieval Network), a lightweight memory layer that proactively archives every conversation turn and restores relevant details after compaction via hybrid retrieval -- requiring zero LLM calls and adding fewer than 25ms of latency per turn. On 94 real multi-turn conversations (1,894 ground-truth facts, human-validated at kappa=0.81), LANTERN-Rerank recovers 78.3% of verifiable facts lost to compaction, significantly outperforming a faithful reimplementation of MemGPT's LLM-driven extraction and multi-query search pipeline (72.4%; Wilcoxon p<0.0001, 95% CI [+3.1, +8.6] pp, d=0.43) at a fraction of the inference cost. Even without the reranker, base LANTERN matches or exceeds this LLM-driven baseline (p=0.005) using zero LLM calls. When four production LLMs answer fact-bearing questions using LANTERN-restored context, accuracy improves by 8.4 percentage points on average (Wilcoxon p<0.05 for each model individually), demonstrating that the recovered context is useful across diverse model architectures. We release the full evaluation framework -- paired significance tests, failure analysis, fact-type stratification, and compaction robustness analysis -- to support reproducibility and future work.

长对话记忆机制检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。