arXiv:2605.11567cs.CV2026-05

让视觉语言动作模型自适应决定执行多长的动作序列,提升稳定性和效率。

Dynamic Execution Commitment of Vision-Language-Action Models

论文配图:Dynamic Execution Commitment of Vision-Language-Action Models
图 1 · 摘自论文原文
  • 通过群体采样计算动作共识度,动态生成可验证的执行前缀。
  • 在多个基准上实现更高成功率与更优推理吞吐量,无需人工调参。
  • 适合需要高鲁棒性的机器人控制、自动驾驶等实时决策场景。

视觉-语言-动作(VLA)模型通常采用动作分块策略,即在一次前向传播中预测并提交短时程连续低级动作,以摊销大规模骨干网络的推理成本并降低每步延迟。然而,将多步预测提交至真实世界执行时,需在成功率与推理效率间权衡,这一决策通常由针对任务固定的执行时长决定。此类启发式方法忽略了预测可靠性对状态的依赖性,导致在动态或分布外环境下表现脆弱。本文提出A3——一种自适应动作接受机制,将动态执行承诺重构为自推测前缀验证问题。A3首先通过群体采样计算轨迹级动作共识分数,再选取代表性草稿并优先进行下游验证。具体包括:(1) 共识有序条件不变性,通过判断低共识动作在以高共识动作条件重解码后是否仍保持一致来验证其可靠性;(2) 前缀闭合顺序一致性,通过仅接受从起始位置开始的最长连续已验证动作序列来保障物理执行完整性。由此,执行时长自然成为同时满足内部模型逻辑与顺序执行约束的最长可验证前缀。跨多种VLA模型与基准的实验表明,A3消除了手动调整时长的需求,同时在执行鲁棒性与推理吞吐量之间实现了更优平衡。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models predominantly adopt action chunking, i.e., predicting and committing to a short horizon of consecutive low-level actions in a single forward pass, to amortize the inference cost of large-scale backbones and reduce per-step latency. However, committing these multi-step predictions to real-world execution requires balancing success rate against inference efficiency, a decision typically governed by fixed execution horizons tuned per task. Such heuristics ignore the state-dependent nature of predictive reliability, leading to brittle performance in dynamic or out-of-distribution settings. In this paper, we introduce A3, an Adaptive Action Acceptance mechanism that reframes dynamic execution commitment as a self-speculative prefix verification problem. A3 first computes a trajectory-wise consensus score of actions via group sampling, then selects a representative draft and prioritizes downstream verification. Specifically, it enforces: (1) consensus-ordered conditional invariance, which validates low-consensus actions by judging whether they remain consistent when re-decoded conditioned on high-consensus actions; and (2) prefix-closed sequential consistency, which guarantees physical rollout integrity by accepting only the longest continuous sequence of verified actions starting from the beginning. Consequently, the execution horizon emerges as the longest verifiable prefix satisfying both internal model logic and sequential execution constraints. Experiments across diverse VLA models and benchmarks demonstrate that A3 eliminates the need for manual horizon tuning while achieving a superior trade-off between execution robustness and inference throughput.

视觉语言动作自适应执行机器人控制推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。