arXiv:2605.13382cs.RO2026-05被引 3

用分块扩散加速视觉语言动作模型推理,兼顾速度与准确性。

BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning

论文配图:BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning
图 1 · 摘自论文原文
  • 将自回归模型改造成分块扩散框架,块内并行生成,块间保持因果关系。
  • 在LIBERO和SimplerEnv上实现3.3倍推理加速,长任务早期训练即表现更优。
  • 适合需要实时响应的机器人控制场景,尤其擅长复杂长序列任务。

虽然自回归(AR)视觉语言动作(VLA)模型在机器人任务中展现出强大的推理能力,但其串行解码过程常导致高延迟,并在长时序执行中放大误差累积。离散扩散语言模型(dLLMs)通过并行标记精炼提供了有前景的替代方案,但其在机器人领域的实际部署受限于重复的去噪函数评估(NFE)以及难以直接应用标准的键值缓存到双向迭代解码中。为此,我们提出BlockVLA,一种通过分块扩散范式将预训练自回归骨干转化为高效离散扩散策略的框架。BlockVLA在块级别保持自回归依赖的同时,允许每个块内并行去噪,从而结合全局因果一致性与局部并行生成。该设计支持已完成块的前缀键值缓存复用,降低迭代去噪的有效成本,并实现从自回归预训练到扩散策略微调的平滑过渡。我们在LIBERO和SimplerEnv基准上进行了广泛评估,结果表明,BlockVLA相比标准离散扩散基线实现了3.3倍的推理加速。此外,模型表现出更优的训练效率,成功率收敛显著快于基线,这一优势在复杂、长时序任务中尤为明显,块模型在训练初期即取得显著性能提升。本工作确立了分块扩散作为大规模预训练自回归模型与高效高频实时机器人控制之间的坚实桥梁。

原文摘要 · Abstract (English)

While autoregressive (AR) Vision-Language-Action (VLA) models have demonstrated formidable reasoning capabilities in robotic tasks, their sequential decoding process often incurs high inference latency and may amplify error accumulation during long-horizon execution. Discrete Diffusion Language Models (dLLMs) provide a promising alternative through parallel token refinement, but their practical deployment in robotics remains limited by repeated denoising function evaluations (NFEs) and the difficulty of directly applying standard KV caching to bidirectional iterative decoding. To bridge these paradigms, we propose BlockVLA, a framework that adapts pretrained AR backbones into an efficient discrete diffusion policy through a block diffusion paradigm. BlockVLA maintains autoregressive dependencies at the block level while enabling parallel denoising within each block, thereby combining global causal coherence with local parallel generation. This design enables prefix KV-cache reuse across completed blocks, reduces the effective cost of iterative denoising, and provides a smoother transition from AR pretraining to diffusion-based policy fine-tuning. We conduct extensive evaluations on the LIBERO and SimplerEnv benchmarks. Experimental results demonstrate that our BlockVLA achieves a 3.3$\times$ inference acceleration over standard discrete diffusion baselines. Furthermore, our model exhibits superior training efficiency, with success rates converging substantially faster than baselines, a gain that is particularly pronounced in complex, long-horizon tasks, where BlockVLA achieves significant performance gains in the early stages of training. This work establishes Block Diffusion as a robust bridge between large-scale pretrained AR models and efficient, high-frequency real-time robotic control.

机器人控制扩散模型推理加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。