研究视觉语言动作模型中各组件冗余度,发现语言模块可大幅精简。
Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?

- 通过移除Transformer块并微调,测试模型各部分必要性。
- 移除一半语言模块后成功率从95.0%升至98.3%,性能反而提升。
- 视觉与动作路径更敏感,适合关注模型效率与轻量化设计者。
视觉-语言-动作(VLA)模型实现指令驱动的机器人操作,但其继承自预训练视觉语言模型的巨大语言主干,其容量远超短指令任务所需。这引发一个基本问题:在闭环控制中,模型有多少是真正必要的?本文通过移除Transformer块这一可控干预手段,研究VLA模型的架构冗余。提出「丢弃-恢复」(DTR)分析协议:移除特定块后微调模型,评估被移除能力是否必需。为确保干预可靠,引入「门探针」(GateProbe),一种单次采样虚拟门敏感度指标,按对下游动作损失的贡献排序模块。在多个VLA架构、操作基准及真实工业机器人场景中,发现显著不对称的恢复能力:语言主干在标准操作任务中高度冗余,而视觉和动作路径则容忍度较低。在LIBERO上,移除一半大语言模型(LLM)块后,OpenVLA-OFT成功率从95.0%提升至98.3%,仅保留两个语言块仍可恢复基线性能。结果表明当前VLA基准对深层语言接地和组合指令理解压力有限,未来架构应更审慎分配语言、视觉与动作组件容量。代码开源:https://github.com/s1ghhh/VLADrop。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models enable instruction-driven robotic manipulation, but they inherit oversized language backbones from pretrained VLMs whose capacity far exceeds what is needed for short robotic instructions. This raises a basic question: how much of a VLA model is actually necessary for closed-loop control? In this work, we study architectural redundancy in VLA models by using transformer block removal as a controlled intervention. We introduce \textbf{Drop-Then-Recovery (DTR)}, an analysis protocol that removes selected blocks from a pretrained VLA model and then fine-tunes the resulting model to measure whether the removed capacity was necessary for downstream control. To make this intervention reliable, we propose \textbf{GateProbe}, a one-shot virtual-gate sensitivity metric that ranks blocks by their contribution to the downstream action loss. Across multiple VLA architectures, manipulation benchmarks and even real-robot industrial scenarios, we find a strong asymmetry in post-removal recoverability: \ul{\textit{language backbones are highly redundant for standard robotic manipulation tasks, whereas vision and action pathways are substantially less tolerant to removal}}. On LIBERO, removing half of the LLM blocks even improves OpenVLA-OFT from 95.0% to 98.3% under the same downstream fine-tuning budget, and retaining only two language blocks still recovers baseline-level performance. These results suggest that current VLA benchmarks may exert limited pressure on deep language grounding and compositional instruction understanding, and that future VLA architectures should allocate capacity more deliberately across language, vision, and action components. The code is available at https://github.com/s1ghhh/VLADrop.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。