arXiv:2608.08725cs.RO2026-08

让机器人生成动作更安全高效,能自动避开碰撞。

WA-SpecDec: World-Aware Speculative Decoding for Vision-Language-Action Models

论文配图:WA-SpecDec: World-Aware Speculative Decoding for Vision-Language-Action Models
图 1 · 摘自论文原文
  • 引入世界感知机制,在生成动作时考虑环境物理状态。
  • 在宽松验证规则下仍保持更高任务成功率,最长可接受前缀延长。
  • 适合对实时性和安全性要求高的机器人控制场景。

视觉-语言-动作(VLA)策略通过自回归方式生成机器人控制指令,导致闭环延迟主要由重复的目标模型前向计算造成。推测解码通过并行验证一批草案动作令牌来降低该开销,近期VLA方法进一步放宽了令牌级接受标准,因为动作令牌空间中微小差异通常对应相似的连续控制。然而,这种放松仍缺乏场景感知:固定的距离容忍度将相同动作令牌偏差视为在所有状态下均等安全,尽管在空旷区域无害的偏差在接触附近可能导致碰撞或抓取失败。我们提出WA-SpecDec,一种世界感知的推测解码框架,在VLA预填充阶段注入由世界模型推导出的物理场景意识,生成共享的世界感知预填充状态,用于草案生成与目标验证,无需修改现有的宽松接受规则。在三种先进松弛接受方案下,WA-SpecDec在更宽松的松弛条件下维持更高任务成功率,并支持更长的可接受前缀。在相当成功率的操作点上,相比仅使用VLA推测解码,速度提升1.5倍;相对于相应基线,近接触失败率平均降低18.6%。

原文摘要 · Abstract (English)

Vision-language-action (VLA) policies generate robot controls autoregressively, making closed-loop latency dominated by repeated target-model forward passes. Speculative decoding reduces this cost by verifying blocks of draft action tokens in parallel, and recent VLA methods further relax token-level acceptance because small differences in action-token space often map to similar continuous controls. However, this relaxation remains scene-agnostic. A fixed token-distance tolerance treats the same action-token deviation as equally safe across states, although deviations that are harmless in free space can cause collisions or grasp failures near contact. We propose WA-SpecDec, a world-aware speculative decoding framework that injects world-model-derived physical scene awareness during the VLA prefill stage, producing shared world-aware prefill states for draft proposal and target verification without changing the relaxed acceptance rule. Across three state-of-the-art relaxed acceptance schemes, WA-SpecDec preserves higher task success under looser relaxation and enables longer accepted prefixes. At comparable-success operating points, WA-SpecDec achieves a 1.5x matched-success speedup over VLA speculative decoding alone and reduces near-contact failure (NCF) by 18.6% on average relative to the corresponding speculative baselines.

机器人控制推测解码多模态强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。