用离散扩散模型提升机器人动作生成的准确性和鲁棒性
Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies
- 将动作分块离散化,在统一变压器中用扩散方式逐步优化
- 在LIBERO数据集上达96.4%成功率,显著优于传统方法
- 适合需要高精度动作生成的机器人任务,尤其擅长处理复杂指令
视觉-语言-动作(VLA)模型通过大型视觉-语言骨干网络将图像和指令映射为机器人动作。然而,现有VLA要么以固定顺序自回归生成动作且性能不佳,要么在骨干网络外附加独立扩散头,导致信息路径割裂,难以实现统一可扩展架构。本文提出离散扩散VLA,将动作块离散化,并在统一Transformer骨干网络内采用离散扩散模式进行渐进式优化。该方法实现自适应解码顺序,优先处理高置信度动作元素,通过二次重掩码机制回访不确定预测,实现稳健纠错。该设计保留预训练视觉-语言先验,支持并行解码,提升效率。在LIBERO上平均成功率达96.4%,在SimplerEnv-Fractal上视觉匹配达71.2%,在SimplerEnv-Bridge上整体达54.2%。在LIBERO-Goal的分布外测试中,语言退化仅0.8%(对比并行解码的8.0%),视觉退化20.4%(对比连续扩散的29.0%),充分展现对预训练视觉-语言能力的良好保留。我们还在AgileX Cobot Magic平台上进行了两次真实机器人验证,证明方法有效性。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models adapt large vision-language backbones to map images and instructions into robot actions. However, prevailing VLAs either generate actions autoregressively in a fixed left-to-right order with poor performance or attach separate diffusion heads outside the backbone that fragments information pathways and hinders unified, scalable architectures. Instead, we present Discrete Diffusion VLA that discretizes action chunks and models them with discrete diffusion pattern retaining progressive refinement inside the unified transformer backbone. Our method achieves an adaptive decoding order that resolves high-confidence action elements before harder ones and employs secondary re-masking to revisit uncertain predictions, enabling robust error correction. This design preserves pretrained vision-language priors, supports parallel decoding, and improves the efficiency. Discrete Diffusion VLA achieves 96.4% avg. success on LIBERO, 71.2% visual matching on SimplerEnv-Fractal, and 54.2% overall on SimplerEnv-Bridge. On out-of-distribution tests of LIBERO-Goal, our method exhibits only 0.8% language degradation versus 8.0% of parallel decoding, and 20.4% vision degradation versus 29.0% for continuous diffusion, demonstrating well retention of pretrained vision-language capabilities. We also conduct two real-robot evaluations on AgileX Cobot Magic platform to show the method's effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。