arXiv:2606.01790cs.CVcs.AI2026-06

提出新方法压缩GUI视觉语言模型的键值缓存,显著降低显存占用。

STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models

论文配图:STaR-KV: Spatio-Temporal Adaptive Re-weighting for KV Cache Compression in GUI Vision-Language Models
图 1 · 摘自论文原文
  • 按空间注意力子空间动态评估视觉标记重要性
  • 通过时间稳定性抑制重复缓存,降低40%峰值显存
  • 无需训练,适用于各类交互式界面智能体

基于视觉语言模型的图形用户界面(GUI)代理展现出强大的自动化能力,但部署受限于随交互步数线性增长的键值(KV)缓存。例如,UI-TARS-1.5-7B仅在五张截图下就占用76 GB GPU内存,接近主流80 GB加速器容量。现有KV压缩方法依赖两个结构假设:将视觉标记重要性聚合为单一共享显著图,并对融合得分分布采用固定前B项截断。初步测量结果反驳了这两点:空间特异性存在于注意力子空间层面且跨层迁移,得分分布形状沿轨迹漂移。本文提出无需训练的STaR-KV(时空自适应重加权)框架,从三个维度校准标记重要性:(i) 基于在线空间互信息的子空间感知评分;(ii) 抑制持续被关注子空间中冗余缓存的时间稳定性折扣;(iii) 由熵导出的温度自适应重塑得分分布。在四个GUI基准上,STaR-KV在相同压缩预算下平均准确率超越现有方法(如GUIKV、SnapKV),压缩阶段无额外计算开销(-0.07% FLOPs),在20% KV缓存预算下将峰值GPU内存减少近40%。代码已开源。

原文摘要 · Abstract (English)

Vision-language-model-based graphical user interface (GUI) agents have shown broad automation capabilities, yet deployment is bottlenecked by a key-value (KV) cache that grows linearly with interaction steps. For instance, UI-TARS-1.5-7B consumes 76 GB of GPU memory on merely five screenshots, approaching the capacity of mainstream 80 GB accelerators. Existing KV compression methods share two structural assumptions: aggregating visual-token importance into a single shared saliency map, and applying a fixed top-B cutoff to the fused score distribution. Pilot measurements refute both: spatial specialization lives at the attention-subspace level and migrates across layers, while the score distribution drifts in shape along a trajectory. We propose STaR-KV (Spatio-Temporal Adaptive Re-weighting), a training-free KV cache compression framework that calibrates token importance along three axes: (i) subspace-aware scoring driven by online spatial mutual information; (ii) a temporal stability discount that suppresses redundant cache entries from persistently attended subspaces; and (iii) an entropy-derived temperature that adaptively reshapes the score distribution. Across four GUI benchmarks, STaR-KV achieves the strongest average accuracy among state-of-the-art KV compression methods (e.g., GUIKV, SnapKV) at matched budgets, with no compression-stage FLOPs overhead (-0.07%) and cutting peak GPU memory by nearly 40% at a 20% KV-cache budget. Code is available at https://github.com/kawhiiiileo/STaR-KV.

KV缓存压缩视觉语言模型显存优化GUI代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。