arXiv:2608.21247cs.CVcs.RO2026-08

为视觉语言动作模型设计可感知动作差异的令牌压缩方法

Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models

论文配图:Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models
图 1 · 摘自论文原文
  • 基于动作响应定义令牌变化的可接受阈值,实现安全压缩
  • 在LIBERO基准上,极端压缩下仍保持动作可靠性
  • 适合对延迟敏感的机器人闭环控制场景

令牌压缩已成为降低大模型推理成本的关键技术,广泛应用于视觉语言模型,并逐步拓展至具身智能体。在具身智能体中,令牌不仅支持感知与语义理解,还直接影响低延迟闭环机器人动作预测。现有方法多依赖冗余或重要性线索(如视觉相似性、注意力分数、显著性)进行压缩指导,但这些线索仅间接反映安全压缩的核心因素:令牌变化多大时会导致下游动作不可接受的偏差。这一接收端容忍度与“恰可察觉差异”(JND)原理密切相关。经典JND描述人类视觉系统的信号耐受性,而机器导向的JND将其扩展至下游机器响应。本文提出Action-JND,将JND建模延伸至具身感知,通过语言条件下的动作响应定义察觉性,在闭环控制中,仅当动作偏差在可容忍范围内时,令牌变化才被视为可接受。为此,我们设计了一种轻量级的逐令牌JND估计算法,基于深层视觉特征空间预测最大可容忍扰动,从而生成动作容差评分,作为插件式压缩准则(如过时KV复用、令牌剪枝),优先压缩对动作影响小的令牌。在LIBERO基准上,使用OpenVLA和OpenVLA-OFT的实验表明,Action-JND在激进压缩比下始终提升压缩可靠性。

原文摘要 · Abstract (English)

Token compression has become a key technique for reducing the inference cost of large foundation models, with approaches such as token pruning and KV-cache reuse widely adopted in vision-language models and recently explored for embodied agents. In embodied agents, tokens not only support perception and semantic understanding but also directly affect latency-sensitive closed-loop robot action prediction. Existing schemes typically guide compression using redundancy or importance cues, such as visual similarity, attention scores, and saliency. However, these cues only indirectly measure the key factor for safe compression: how much a token can change before causing an unacceptable deviation in downstream actions. This receiver-dependent tolerance is closely related to the principle of just noticeable difference (JND). Classical JND characterizes signal tolerance in the human visual system, while machine-oriented JND extends this concept to downstream machine responses. Building on this progression, we introduce Action-JND, which extends JND modeling to embodied perception by defining noticeability through the language-conditioned action response of a vision-language-action (VLA) policy in closed-loop control. A token change is considered admissible only when the induced action deviation remains within a tolerated margin. To realize this concept, we develop a lightweight token-wise JND estimator in deep visual-feature space to predict the maximum tolerable perturbation while preserving policy responses. The resulting action-tolerance score serves as a plug-and-play criterion for VLA compression paradigms, including stale-KV reuse and token pruning, prioritizing action-tolerant tokens for compression. Experiments on the LIBERO benchmark with OpenVLA and OpenVLA-OFT demonstrate that Action-JND consistently improves compression reliability, especially under aggressive compression ratios.

令牌压缩具身智能动作感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。