让机器人动作生成更灵活,能自动纠错。
AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Models
- 采用非均匀时间调度的动作生成,结合上下文动态调整。
- 通过置信度评估器识别并修正不准确动作,提升长程任务稳定性。
- 支持同步与异步两种模式,兼顾效率与鲁棒性,适合真实机器人部署。
视觉-语言-动作(VLA)模型已成为构建通用机器人的有力范式。然而,传统基于流匹配(FM)的VLA模型通常依赖固定统一的时间调度,即同步流匹配(SFM),缺乏动作上下文感知和异步自纠正能力,在长时序任务中易因单个动作错误引发连锁失败。本文提出异步流匹配VLA(AsyncVLA),引入时间灵活性的异步流匹配(AFM),实现动作生成的上下文感知与自纠正。AsyncVLA突破传统SFM的均一时间调度,根据动作上下文非均匀生成动作令牌;同时引入置信度评估器,提取初始动作的置信度,实现执行前对不准确动作的有选择性精修。此外,我们提出一种统一训练流程,使单一模型同时具备SFM与AFM能力,提升键值缓存利用率。在多个机器人操作基准测试中,AsyncVLA展现数据高效性与自纠正能力,显著优于现有方法,涵盖仿真与真实世界评估。代码已公开于https://github.com/YuhuaJiang2002/AsyncVLA。
原文摘要 · Abstract (English)
Vision-language-action (VLA) models have recently emerged as a powerful paradigm for building generalist robots. However, traditional VLA models that generate actions through flow matching (FM) typically rely on rigid and uniform time schedules, i.e., synchronous FM (SFM). Without action context awareness and asynchronous self-correction, SFM becomes unstable in long-horizon tasks, where a single action error can cascade into failure. In this work, we propose asynchronous flow matching VLA (AsyncVLA), a novel framework that introduces temporal flexibility in asynchronous FM (AFM) and enables self-correction in action generation. AsyncVLA breaks from the vanilla SFM in VLA models by generating the action tokens in a non-uniform time schedule with action context awareness. Besides, our method introduces the confidence rater to extract confidence of the initially generated actions, enabling the model to selectively refine inaccurate action tokens before execution. Moreover, we propose a unified training procedure for SFM and AFM that endows a single model with both modes, improving KV-cache utilization. Extensive experiments on robotic manipulation benchmarks demonstrate that AsyncVLA is data-efficient and exhibits self-correction ability. AsyncVLA outperforms existing methods across both simulation and real-world evaluations. Our code is available at https://github.com/YuhuaJiang2002/AsyncVLA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。