arXiv:2607.00696cs.CV2026-07

提出在线记忆压缩框架Imprint,让长期第一人称问答更高效准确。

Imprint: Online Memory Compression for Long-Horizon Egocentric QA

论文配图:Imprint: Online Memory Compression for Long-Horizon Egocentric QA
图 1 · 摘自论文原文
  • 将记忆建模为持续压缩的交互记录,聚焦重复、新近和独特性信号
  • 在EgoLifeQA上提升问答准确率至35.8%,证据关联答案量增6倍
  • 适合需要长时记忆推理的智能助手、可穿戴设备等场景

长期第一人称问答需回答数小时甚至数天前事件。现有方法通过层次化文本摘要构建记忆,虽减小规模但侧重描述压缩而非检索:重复互动被合并为粗略描述,难保留为显式可复用单元。本文提出Imprint,一种以交互为中心的记忆框架,将长期记忆视为在线压缩问题而非摘要。观测数据先转为结构化交互记录,并持续组织为重复模式。结合人类记忆中的重复性、新近性和独特性信号,选择性保留并压缩交互内容,形成紧凑且利于检索的记忆。在包含七日第一人称数据的EgoLifeQA基准上评估,相同LLM下,Imprint将问答准确率从31.0%提升至35.8%,证据相关回答数量较EgoRAG增加6倍,内存占用减少2.3倍,检索延迟降低11.8倍。结果表明,记忆压缩能为长期第一人称问答提供可扩展且高效的检索基础。

原文摘要 · Abstract (English)

Long-horizon egocentric question answering involves answering about events that have occurred hours or days in the past. This requires memory representations that remain both retrieval-effective and scalable over days or weeks of recording. Existing long-horizon egocentric QA methods construct memory as hierarchical textual summaries of observations. While effective for reducing memory size, summarization optimizes for descriptive compression rather than retrieval: repeated interactions are absorbed into coarse textual descriptions instead of being preserved as explicit, recurring memory units, making long-horizon evidence aggregation difficult. We propose Imprint, an interaction-centric memory framework that formulates long-horizon egocentric memory as an online memory compression problem rather than summarization. Incoming observations are first represented as structured Interaction Records and continuously organized into recurring interaction patterns. Using human memory consolidation signals of recurrence, recency, and distinctiveness, Imprint selectively retains and compresses interactions into a compact retrieval-oriented memory. We evaluate Imprint on EgoLifeQA, a seven-day egocentric benchmark containing questions that require reasoning over interactions occurring hours to days before the query. With the same LLM, Imprint improves QA accuracy from 31.0% to 35.8%, increases evidence-grounded answers by $6\times$ compared with EgoRAG, reduces memory footprint by $2.3\times$, and decreases retrieval latency by $11.8\times$. These results demonstrate that memory compression provides a scalable and retrieval-effective foundation for long-horizon egocentric question answering.

记忆压缩第一人称视觉长时问答检索增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。