不训练即可加速视觉语言动作模型推理,提升机器人响应速度。
ProbeFlow: Training-Free Adaptive Flow Matching for Vision-Language-Action Models
- 通过速度向量夹角判断轨迹复杂度,动态调整求解步数。
- 在MetaWorld上提速14.8倍,平均步数从50降至2.6。
- 适合需要低延迟连续生成策略的机器人控制场景。
近期配备流匹配(Flow Matching, FM)动作头的视觉语言动作(VLA)模型在复杂机器人操作任务中达到顶尖性能。然而,FM所需的多步迭代微分方程求解带来显著推理延迟,难以满足实时物理控制需求。现有加速方法聚焦于优化视觉语言模型(VLM)主干,却忽略了动作头这一瓶颈。为此,本文提出ProbeFlow,一种面向连续机器人控制的无训练自适应推理框架。通过计算初始速度与前瞻速度向量间的余弦相似度,评估轨迹几何复杂度,动态调度积分步数以剪枝冗余网络计算。在MetaWorld基准上,行动解码速度提升14.8倍(平均步数由N=50降至2.6),端到端系统延迟降低2.8倍,且未牺牲操作成功率。在长时程LIBERO基准上,探测机制自动在语义瓶颈处分配更密集的求解序列,有效缓解流求解延迟。真实世界部署验证了ProbeFlow能有效降低动作解码延迟并保障执行稳定性,为低延迟连续生成策略提供实用解决方案。
原文摘要 · Abstract (English)
Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference latency that precludes responsive physical control. While current acceleration efforts optimize the Vision-Language Model (VLM) backbone, the action head bottleneck remains overlooked. To address this, we propose ProbeFlow, a training-free adaptive inference framework tai- lored for continuous robotic control. By evaluating geometric trajectory complexity via the cosine similarity between initial and lookahead velocity vectors, ProbeFlow dynamically sched- ules integration steps to prune redundant network evaluations. On the MetaWorld benchmark, it accelerates action decoding by 14.8x (reducing average steps from N = 50 to 2.6) and cuts end-to-end system latency by 2.8x without compromising the manipulation success rate. On the long-horizon LIBERO benchmark, the probe automatically allocates a denser schedule to navigate semantic bottlenecks, effectively resolving the flow solver delay. Real-world physical deployments confirm that ProbeFlow successfully mitigates action decoding latency while ensuring execution stability, offering a highly practical solution for low-latency continuous generative policies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。