arXiv:2606.20246cs.ROcs.AI2026-06

压缩视觉语言动作模型层数,提速降耗还保性能。

Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think

论文配图:Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
图 1 · 摘自论文原文
  • 用单次前向传播识别冗余层,直接删减成对层以减半模型深度。
  • 训练时间减少40%-50%,实时推理快30%,性能不降反超。
  • 无需微调即可适配多种机器人和任务,适合高效部署场景。

基于大规模视频-机器人数据预训练的视觉语言动作(VLA)模型虽革新了机器人操作,但其数十亿参数架构在下游微调和实时推理中带来巨大计算负担。本文揭示这些连续控制基础策略(如 pi_0、GR00T-N1.5)存在严重的层间表征冗余:尽管训练数据涵盖多样物理轨迹,仍可大幅压缩。我们提出完全无需训练的结构压缩流程,仅通过一次前向传播结合中心核对齐(CKA)识别冗余层特征,移除成对层,实现模型深度永久压缩达50%。经优化的轻量架构在下游微调中显著加速:训练时间减少40%-50%,实时推理速度提升最高30%,同时性能匹配或超越完整模型。我们在三个仿真基准(LIBERO、RoboCasa、SimplerEnv)及四个不同机器人平台上的10项真实世界操作任务中全面验证该方法。结果表明,先进VLA所需层数远低于此前预期,为可扩展机器人学习提供高效计算范式。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models pre-trained on massive video-robot datasets have revolutionized robotic manipulation, yet their multi-billion parameter architectures impose prohibitive computational burdens during downstream fine-tuning and real-time inference. In this work, we reveal a highly non-trivial architectural characteristic of these continuous control foundation policies (e.g., pi_0, GR00T-N1.5): despite being trained on diverse physical trajectories, they exhibit severe layer-wise representational redundancy. To exploit this, we introduce a structural compression pipeline that is entirely training-free, bypassing the need of existing methods to load full-scale models to learn optimized token reductions or dynamic layer selectors. Instead, using only a single forward pass via Centered Kernel Alignment to identify redundant layer features, we remove twin layers to permanently compress the model depth by up to 50% across both the VLM backbone and the continuous control policy head. Downstream fine-tuning of this streamlined architecture yields a dual acceleration benefit: a 40-50% reduction in training time and up to 30% faster real-time inference, while matching or exceeding full-scale base model performance. We comprehensively validate our method across three simulation benchmarks (LIBERO, RoboCasa, SimplerEnv) and 10 diverse real-world manipulation tasks across 4 unique robotic embodiments. These results prove that advanced VLAs require significantly fewer layers than previously assumed, offering a highly compute-efficient paradigm for scalable robot learning.

模型压缩机器人学习VLA高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。