arXiv:2512.09927cs.RO2025-12被引 5

不重训练实现视觉语言动作模型加速,推理快且准确率不降

Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models

  • 通过动态扩展注意力区域附近令牌,增强上下文完整性
  • 深层中按动作感知引导选择性合并令牌,减少冗余
  • 无需重训练,单次前向传播即可提速,适合实时机器人部署

视觉-语言-动作(VLA)模型在大规模多模态数据上预训练后,已成为机器人感知与控制的强大基础。然而其规模庞大(常达数十亿参数),导致推理计算开销大、延迟高,在动态环境中难以实时部署。为此,本文提出无需训练的令牌压缩框架TEAM-VLA,可在不改变模型参数的前提下加速推理并保持任务性能。TEAM-VLA引入动态令牌扩展机制,识别注意力聚焦区域附近的有信息量令牌并采样,提升上下文完整性;随后在深层中基于动作感知引导选择性合并,有效降低冗余同时维持语义连贯性。通过在一次前向传播中协同完成扩展与合并,实现效率与效果的平衡。在LIBERO基准上的大量实验表明,TEAM-VLA consistently 提升推理速度,同时任务成功率与全模型持平甚至更优。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models pretrained on large-scale multimodal datasets have emerged as powerful foundations for robotic perception and control. However, their massive scale, often billions of parameters, poses significant challenges for real-time deployment, as inference becomes computationally expensive and latency-sensitive in dynamic environments. To address this, we propose Token Expand-and-Merge-VLA (TEAM-VLA), a training-free token compression framework that accelerates VLA inference while preserving task performance. TEAM-VLA introduces a dynamic token expansion mechanism that identifies and samples additional informative tokens in the spatial vicinity of attention-highlighted regions, enhancing contextual completeness. These expanded tokens are then selectively merged in deeper layers under action-aware guidance, effectively reducing redundancy while maintaining semantic coherence. By coupling expansion and merging within a single feed-forward pass, TEAM-VLA achieves a balanced trade-off between efficiency and effectiveness, without any retraining or parameter updates. Extensive experiments on LIBERO benchmark demonstrate that TEAM-VLA consistently improves inference speed while maintaining or even surpassing the task success rate of full VLA models. The code is public available on \href{https://github.com/Jasper-aaa/TEAM-VLA}{https://github.com/Jasper-aaa/TEAM-VLA}

视觉语言动作模型压缩推理加速机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。