arXiv:2608.07408cs.CVcs.LG2026-08被引 1

让视频世界模型长期记住过去画面,解决记忆失效问题。

Addressable Memory for Video World Models

论文配图:Addressable Memory for Video World Models
图 1 · 摘自论文原文
  • 给压缩后的记忆分配虚拟位置,保持可定位性。
  • 在长距离回溯任务中,回忆准确率提升19.5%。
  • 无需重新训练,适合需要长期视觉记忆的生成任务。

我们研究交互式视频世界模型中的视觉持续性问题。这类模型依赖键值缓存作为动态增长的视觉记忆,以传递先前生成的帧。然而,当推演超出训练范围时,时间旋转位置编码(RoPE)偏移量会超出训练时的分布,导致模型无法可靠访问存储内容,注意力机制难以检索相关视觉信息。此外,直接在RoPE旋转空间压缩缓存会因混合不兼容的位置相位而破坏记忆。为此,我们提出WorldTrace——一种无需训练的记忆框架,通过为每个摘要槽分配独特的、在分布内的虚拟位置,使压缩记忆仍可被定位。在该可定位缓存中,我们探索两种压缩策略:WorldTrace-Field为保持时间连贯性压缩历史;WorldTrace-Landmark在检测到场景转换时存储原始场景痕迹,用于情景式召回。我们进一步引入LoopBench基准,评估压缩缓存能否在长时间绕行后重建曾访问过的场景。实验表明,WorldTrace-Field在时间一致性上提升15.5%,WorldTrace-Landmark在LoopBench上提升19.5%,实现了无需重训的视觉持久生成扩展。

原文摘要 · Abstract (English)

We study visual persistence in interactive video world models. These models rely on a Key-Value (KV) cache as a growing visual memory to carry forward previously generated frames. However, we find that models can no longer reliably address stored content once rollouts extend beyond the training horizon, because temporal Rotary Positional Embeddings (RoPE) offsets then fall outside the range seen during training and the model struggles to retrieve the relevant visual information through attention. Moreover, naively compressing the cache in the RoPE-rotated space corrupts memory by averaging together incompatible positional phases. To address this, we propose WorldTrace, a training-free memory framework for long-horizon visual persistence. WorldTrace keeps compressed memory addressable by assigning each summary slot a distinct, in-distribution virtual position. Within this addressable cache, we study two memory compression approaches: WorldTrace-Field compresses history for temporal coherence, while WorldTrace-Landmark stores verbatim scene traces at detected transitions for episodic recall. We further introduce LoopBench, a benchmark evaluating whether a compressed cache can reconstruct a previously visited scene after a long detour. WorldTrace-Field improves temporal consistency by +15.5%, and WorldTrace-Landmark improves episodic recall by +19.5% on LoopBench, extending visually persistent generation without retraining.

视频生成记忆机制世界模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。