arXiv:2603.00188cs.CVcs.AI2026-03中稿 · EMNLP被引 3

无需训练的缓存压缩方法,专为长序列GUI交互优化,显著提升效率与精度。

ST-Lite: Training-Free KV Cache Compression with Spatio-Trajectory Guidance for Long-Horizon GUI Agents

  • 基于轨迹与空间显著性,精准保留关键视觉元素和交互信息。
  • 在20%缓存预算下,任务准确率媲美全量缓存,解码速度提升2.35倍。
  • 适用于资源受限场景下的视觉语言GUI代理部署,尤其适合长期交互任务。

无训练的KV缓存压缩对在内存与延迟约束下部署视觉-语言GUI代理至关重要,但现有方法针对通用语言任务设计,忽略了GUI交互轨迹的独特结构。我们识别出三个GUI特有工作负载特性:高帧间视觉冗余、极小的UI元素空间覆盖范围、以及近似均匀的跨层注意力稀疏性,导致现有方案在标准20%预算下仅保留39%的原始重要KV对。为此,我们提出ST-Lite,一种无训练压缩方案,其三个组件分别针对上述特性:轨迹感知语义门控(TSG)过滤冗余历史帧,组件中心空间显著性(CSS)保留细粒度元素边界,扁平化每层预算避免层级误分配。在七个GUI基准与两个骨干网络上,于10%-40%部署相关缓存窗口中,ST-Lite持续优于所有现有压缩基线,在20%预算下达到主干模型全缓存任务准确率,同时实现五倍压缩下的2.35倍解码加速。代码已开源:https://github.com/94wen94/ST-Lite。

原文摘要 · Abstract (English)

Training-free KV cache compression is essential for deploying vision-language GUI agents under memory and latency constraints, yet existing methods are designed for generic language workloads and ignore the distinctive structure of GUI interaction traces. We characterize three GUI-specific workload properties--high inter-frame visual redundancy, extremely small UI-element spatial footprints, and near-uniform cross-layer attention sparsity--that cause existing schemes to retain as few as 39% of oracle-important KV pairs at the standard 20% budget. To address this, we propose ST-Lite, a training-free compression scheme whose three components each target one property: Trajectory-aware Semantic Gating (TSG) filters redundant historical frames, Component-centric Spatial Saliency (CSS) preserves fine-grained element boundaries, and a flat per-layer budget avoids hierarchical misallocation. Across seven GUI benchmarks and two backbones in the deployment-relevant 10%-40% window, ST-Lite consistently outperforms all existing compression baselines, matching or exceeding Full Cache task accuracy on the primary backbone at the 20% budget while delivering up to 2.35x decoding speedup at fivefold compression. The implementation is available at https://github.com/94wen94/ST-Lite.

缓存压缩GUI代理推理加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。