无需训练即可加速压缩视觉语言动作模型,显著降低计算开销。
EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models

- 通过分析层间冗余,剪裁语言模块中无用层以减少计算。
- 任务感知筛选视觉标记,兼顾关键信息与多样性,提升效率。
- 缓存复用扩散动作头的中间特征,缓解迭代过程冗余。
视觉-语言-动作(VLA)模型,尤其是基于扩散架构的模型,在具身智能领域具有变革潜力,但其高计算和内存需求严重受限于固有及推理时的冗余。现有加速方法多针对单一低效环节,难以全面解决整个管道中的多重瓶颈,制约实际部署。本文提出 EfficientVLA,一种结构化、无需训练的推理加速框架,通过协同利用多层次冗余系统性突破障碍。该框架整合三项策略:(1) 基于层间冗余分析,剪裁语言模块中功能无关的层;(2) 采用任务感知策略,选取紧凑且多样化的视觉标记,平衡任务关键性与信息覆盖;(3) 通过战略性缓存与复用扩散动作头中的关键中间特征,缓解时间维度冗余。在标准 VLA 模型 CogACT 上应用,实现 1.93 倍推理加速,浮点运算量降至 28.9%,仅导致 SIMPLER 基准成功率下降 0.6%。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models, particularly diffusion-based architectures, demonstrate transformative potential for embodied intelligence but are severely hampered by high computational and memory demands stemming from extensive inherent and inference-time redundancies. While existing acceleration efforts often target isolated inefficiencies, such piecemeal solutions typically fail to holistically address the varied computational and memory bottlenecks across the entire VLA pipeline, thereby limiting practical deployability. We introduce EfficientVLA, a structured and training-free inference acceleration framework that systematically eliminates these barriers by cohesively exploiting multifaceted redundancies. EfficientVLA synergistically integrates three targeted strategies: (1) pruning of functionally inconsequential layers from the language module, guided by an analysis of inter-layer redundancies; (2) optimizing the visual processing pathway through a task-aware strategy that selects a compact, diverse set of visual tokens, balancing task-criticality with informational coverage; and (3) alleviating temporal computational redundancy within the iterative diffusion-based action head by strategically caching and reusing key intermediate features. We apply our method to a standard VLA model CogACT, yielding a 1.93X inference speedup and reduces FLOPs to 28.9%, with only a 0.6% success rate drop in the SIMPLER benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。