arXiv:2606.26631cs.CV2026-06

不重放视觉特征也能高效重访,提升多步推理准确性

Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

论文配图:Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning
图 1 · 摘自论文原文
  • 用位置重绑定技术重构历史视觉缓存,避免位置错位
  • 在多个基准上提升平均准确率5%,计算量减少数万倍
  • 适合需要高效视觉重访的多模态推理系统

交错式多模态推理通过在多步生成中重访视觉证据来提升视觉定位效果,但现有方法依赖重复前向传递选定的视觉标记。一个自然的优化思路是直接复用历史视觉键值(KV)缓存。然而我们发现该策略存在关键缺陷:缓存中的视觉键已绑定原始位置上下文,这种过时的位置绑定会在后续解码上下文中扭曲注意力,导致严重的自回归解码崩溃。这表明有效的缓存复用需在与当前解码状态兼容的位置上重建视觉证据,而非直接复制带位置绑定的历史条目。为此,我们提出位置重绑定缓存复用(PRCR),一种无需重放的缓存级视觉重访框架。PRCR保存原始视觉KV缓存及其空间坐标,随后为选中条目重新分配相容坐标并重绑定其键,再将重构后的缓存注入活跃解码器缓存。该设计在保留文本位置连续性的同时维持相对视觉结构。在多个多模态推理基准上的实验表明,PRCR达到或优于重放性能,平均准确率提升5个百分点,视觉重访计算量减少达数万倍。

原文摘要 · Abstract (English)

Interleaved multimodal reasoning improves visual grounding by revisiting visual evidence during multi-step generation, yet existing methods typically rely on token replay, repeatedly forwarding selected visual tokens. A natural shortcut is to reuse the historical visual key-value (KV) cache directly. However, we identify a critical failure mode of this strategy: cached visual keys are already bound to their original positional context. Such stale positional binding distorts attention under later decoding contexts and can trigger severe autoregressive decoding collapse. This failure suggests that effective cache reuse requires reconstructing visual evidence under positions compatible with the current decoding state, rather than directly copying position-bound historical cache entries. To this end, we propose Position Rebinding Cache Reuse (PRCR), a cache-level framework for replay-free visual revisiting. PRCR stores raw visual KV cache together with their original spatial coordinates, then reassigns position-compatible coordinates to select entries and rebinds their keys before injecting the reconstructed cache into the active decoder cache. This design reuses historical visual evidence while preserving textual positional continuity and relative visual structure. Experiments across multiple multimodal reasoning benchmarks show that PRCR achieves replay-level or better performance, improving average accuracy by 5 percent and reducing visual-revisiting computation by up to tens of thousands of times.

多模态推理缓存复用视觉重访

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。