arXiv:2607.19547cs.CVeess.IV2026-07

无需训练即可正确拼接视频键值记忆,解决长时序推理中的时间错位问题。

ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning

  • 用多轴位置编码重建全局时间-空间结构,修复视觉块的时间错位
  • 仅重计算高偏差的后续视频块部分视觉令牌,提升事件排序准确率
  • 速度快3.3倍且无需重新训练,适合长视频问答任务

长视频问答要求模型在不重复处理整个视频的情况下保留视觉证据。一种实用方法是为每个视频片段存储视觉语言模型的内部键值(KV)缓存,并在查询时检索该状态。然而,独立缓存的视频片段无法正确拼接:每个片段均从局部旋转位置零开始预填充,直接拼接会导致时间相位冲突,破坏事件先后顺序、频次统计和变化轨迹等全局时序依赖。本文提出ChronoStitch,一种无需训练的视觉KV记忆拼接方法。该方法首先将已存储的后旋转键值映射到全局三轴多模态旋转位置编码(RoPE)坐标系,以保持时间、高度与宽度结构。我们证明一维标量重索引在几何上不一致,会将帧内空间顺序错误转换为虚假的时间偏移。随后,针对位置修复后残留的内容差距——后期片段原本未关注早期内容——ChronoStitch选择性地重计算少量高偏差的后期视觉令牌,同时允许其在拼接后的缓存上进行注意力计算。在Qwen2.5-VL-3B和TempCompass的时间分割数据集上,ChronoStitch优于朴素拼接和仅位置修复方案,在提升事件排序准确率的同时,运行速度比完整联合重预填充快3.3倍。

原文摘要 · Abstract (English)

Long-video question answering requires a model to preserve visual evidence over time without repeatedly reprocessing the same video. A practical approach is to store the vision-language model's internal key-value (KV) cache for each video chunk and retrieve that state at query time. However, independently cached video chunks do not compose correctly: every chunk is prefilled from local rotary position zero, so naive concatenation collides temporal phases and removes the global order required for questions about what happened first, how often events occurred, or what changed across the video. This paper presents ChronoStitch, a training-free method for composing independently stored visual KV memories. The method first re-bases stored post-rotary keys onto a global three-axis multimodal RoPE coordinate system that preserves time, height, and width structure. We show why a one-dimensional scalar re-indexing is geometrically inconsistent for visual tokens because it turns spatial order within a frame into false temporal displacement. We then address the residual content gap left by positional repair: later chunks were originally encoded without attending to earlier chunks. ChronoStitch therefore selectively recomputes a small fraction of high-deviation later-chunk visual tokens while allowing them to attend over the composed cache. On Qwen2.5-VL-3B and the temporal split of TempCompass, ChronoStitch outperforms naive composition and position-only variants, improving event-ordering accuracy while running 3.3x faster than full joint re-prefilling.

长视频理解视觉记忆时序推理无训练优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。