通过测试时采样与验证,让视觉语言动作模型更可靠地应对真实场景挑战。
RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Models
- 测试时通过采样、扰动和投票生成动作分布,再用视觉语言模型筛选最优动作。
- 在分布外任务上性能提升25%,分布内任务提升9%,新机器人配置下再增7%。
- 适合需要高可靠性部署的机器人系统,尤其对泛化能力要求高的场景。
视觉语言动作(VLA)模型在视觉运动控制中表现出色,但在非结构化真实环境中的鲁棒性仍是一大挑战。本文从测试时采样与验证的角度研究了提升VLA鲁棒性与泛化能力的方法。我们发现,动作误差与生成样本数量之间遵循指数幂律关系,表明存在推理时缩放规律。基于此,提出RoboMonkey框架:部署时从VLA采样少量动作,经高斯扰动与多数投票构建动作提议分布,并使用基于视觉语言模型(VLM)的验证器选择最优动作。我们设计了合成数据生成流程用于训练此类验证器,证明扩大合成数据集可持续提升验证与下游任务准确率。大量模拟与硬件实验表明,将现有VLA与RoboMonkey结合,可在分布外任务上实现25%的绝对性能提升,在分布内任务上提升9%;在适配新机器人配置时,同时微调VLA与验证器比仅微调VLA提升7%。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have demonstrated remarkable capabilities in visuomotor control, yet ensuring their robustness in unstructured real-world environments remains a persistent challenge. In this paper, we investigate test-time scaling through the lens of sampling and verification as means to enhance the robustness and generalization of VLAs. We first demonstrate that the relationship between action error and the number of generated samples follows an exponentiated power law across a range of VLAs, indicating the existence of inference-time scaling laws. Building on these insights, we introduce RoboMonkey, a test-time scaling framework for VLAs. At deployment, RoboMonkey samples a small set of actions from a VLA, applies Gaussian perturbation and majority voting to construct an action proposal distribution, and then uses a Vision Language Model (VLM)-based verifier to select the optimal action. We propose a synthetic data generation pipeline for training such VLM-based action verifiers, and demonstrate that scaling the synthetic dataset consistently improves verification and downstream accuracy. Through extensive simulated and hardware experiments, we show that pairing existing VLAs with RoboMonkey yields significant performance gains, achieving a 25% absolute improvement on out-of-distribution tasks and 9% on in-distribution tasks. Additionally, when adapting to new robot setups, we show that fine-tuning both VLAs and action verifiers yields a 7% performance increase compared to fine-tuning VLAs alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。