arXiv:2603.04885cs.AI2026-03

提出主动记忆框架,实现流式对话中按需回忆且低延迟。

Proactive Memory for Ad-Hoc Recall over Streaming Dialogues

  • 构建分层主动记忆结构,支持多粒度信息提炼与按需召回。
  • 在14,000+问答对上验证,推理保真度更高,延迟显著低于全上下文模型。
  • 适合需要长期记忆、实时响应的对话系统研发者使用。

现实对话通常以无限流的形式展开,因此需要在无限时域内保持有界状态的记忆机制。然而,现有读-思考记忆机制与此场景本质不符,无法在流式过程中支持按需记忆召回。为此,我们引入首个面向流式记忆评估的基准测试集STEM-Bench,包含超过14,000个对话流中的问答对,用于评估感知保真度、时间推理和全局认知能力。初步分析揭示了关键的“保真度-效率困境”:基于检索的方法依赖片段上下文,而全上下文模型则导致无界延迟。为解决该问题,我们提出ProStream,一种基于分层结构的主动记忆框架。它通过多粒度蒸馏,在连续流中实现按需记忆召回;并引入自适应时空优化策略,根据预期效用动态调整保留内容。该方法在保持较低推理延迟的同时,维持了较高的推理保真度。实验表明,ProStream在推理保真度上优于现有基线,同时显著低于全上下文模型的延迟。

原文摘要 · Abstract (English)

Real-world dialogue usually unfolds as an infinite stream. It thus requires bounded-state memory mechanisms to operate within an infinite horizon. However, existing read-then-think memory is fundamentally misaligned with this setting, as it cannot support ad-hoc memory recall while streams unfold. To explore this challenge, we introduce \textbf{STEM-Bench}, the first benchmark for \textbf{ST}reaming \textbf{E}valuation of \textbf{M}emory. It comprises over 14K QA pairs in dialogue streams that assess perception fidelity, temporal reasoning, and global awareness under infinite-horizon constraints. The preliminary analysis on STEM-Bench indicates a critical textit{fidelity-efficiency dilemma}: retrieval-based methods use fragment context, while full-context models incur unbounded latency. To resolve this, we propose \textbf{ProStream}, a proactive memory framework for streaming dialogues built on a hierarchical structure. It enables ad-hoc memory recall on demand by reasoning over continuous streams with multi-granular distillation. Moreover, it employs Adaptive Spatiotemporal Optimization to dynamically optimize retention based on expected utility. It enables a bounded knowledge state for lower inference latency without sacrificing reasoning fidelity. Experiments show ProStream delivers higher reasoning fidelity than prior baselines while maintaining substantially lower latency than full-context alternatives.

记忆机制流式对话主动记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。