arXiv:2606.28338cs.IR2026-06

用视觉化结构记忆提升长对话中历史信息的定位与利用效率

Memory Shot for Long-Term Dialogue

论文配图:Memory Shot for Long-Term Dialogue
图 1 · 摘自论文原文
  • 将连续对话段落转为结构化视觉记忆单元,保留时间顺序与对话轮次
  • 在LoCoMo和LongMemEval上表现稳定,内存构建速度提升70倍
  • 适合需要高效长程记忆的对话系统研发者使用

大语言模型在一般对话、指令遵循和复杂推理方面表现优异,但在长对话场景中常难以定位并利用与当前问题最相关的过往信息。现有方法通过压缩和重组用户交互历史构建以文本为中心的记忆单元,但依赖暴力提取关键证据来关联不同对话会话,导致计算开销大,且削弱了说话人转换、发言边界和局部上下文关系等结构线索。为避免脆弱的文本记忆表示,我们提出MemShot,利用对话结构化建模长对话,并借助模型内部的视觉推理能力关联关键对话片段。具体而言,MemShot将局部连续的对话片段渲染为结构化视觉记忆单元,保留元信息和时间顺序的对话轮次,避免繁重的文本记忆构建。实验结果表明,MemShot在LoCoMo和LongMemEval上均实现稳定且具有竞争力的表现,同时显著缩短内存构建流程,实现70×加速。进一步分析显示,MemShot通过聚焦结构化的局部对话线索而非扁平文本流中的表面词法匹配,提升了历史证据的定位与利用效果。所有代码已发布于https://github.com/NEUIR/MemShot。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated strong capabilities in general conversation, instruction following, and complex reasoning. However, in long-term dialogue settings, they often struggle to locate and utilize historical information most relevant to the current query. Existing approaches address this issue by constructing structured text-centered memory units through compressing and reorganizing user interaction history. However, these systems often rely on brute-force extraction of crucial evidence to associate episodes across dialogue sessions, causing substantial computational overhead and weakening structural cues such as speaker transitions, turn boundaries, and local contextual relationships. To avoid fragile text-based memory representations, we propose MemShot, which leverages dialogue structuring for long-term dialogue modeling and relies on the model's internal visual reasoning capabilities to associate key episodes. Specifically, MemShot renders local contiguous dialogue spans into structured visual memory units, preserving meta-information and chronological dialogue turns while avoiding heavy-weight textual memory construction. Experimental results show that MemShot achieves stable and competitive performance on both LoCoMo and LongMemEval, while substantially shortening the memory construction pipeline and delivering 70$\times$ speedup. Further analysis reveals that MemShot enhances the localization and utilization of historical evidence by directing memory processing toward structured local dialogue cues rather than surface-level lexical matching in a flat text stream. All codes are released on https://github.com/NEUIR/MemShot.

对话系统长程记忆视觉记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。