通过分阶段生成动作,实现高效精准的视觉语言动作策略。
CF-VLA: Efficient Coarse-to-Fine Action Generation for Vision-Language-Action Policies

- 先粗后细两阶段生成:先构建结构化初始动作,再单步微调。
- 低计算量下性能领先:NFE=2时超越现有方法,延迟降低75.4%。
- 适合实时机器人控制,实机成功率高达83.0%,优于当前主流模型。
基于流的视觉-语言-动作(VLA)策略在动作生成中具有强表达能力,但存在根本性效率问题:需多步推断才能从无信息的高斯噪声中恢复动作结构,导致实时约束下效率与质量难以兼顾。本文重新思考生成动作的起始点作用,提出CF-VLA,一种粗到细的两阶段建模框架。粗粒度阶段学习终点速度的条件后验分布,将高斯噪声转化为有动作意义的初始化;细粒度阶段则在此基础上进行固定时间的局部修正。为稳定训练,采用分步策略:先训练可控的粗粒度预测器,再联合优化。在CALVIN和LIBERO数据集上的实验表明,该方法在低NFE(函数评估次数)条件下建立了优异的效率-性能边界:在NFE=2时持续优于现有方法,部分指标达到甚至超过NFE=10的π₀.₅基线,动作采样延迟降低75.4%,实机平均成功率最高达83.0%,优于MIP 19.5个百分点、π₀.₅ 4.0个百分点。结果表明,结构化的粗到细生成能同时实现高性能与高效率。代码已开源。
原文摘要 · Abstract (English)
Flow-based vision-language-action (VLA) policies offer strong expressivity for action generation, but suffer from a fundamental inefficiency: multi-step inference is required to recover action structure from uninformative Gaussian noise, leading to a poor efficiency-quality trade-off under real-time constraints. We address this issue by rethinking the role of the starting point in generative action modeling. Instead of shortening the sampling trajectory, we propose CF-VLA, a coarse-to-fine two-stage formulation that restructures action generation into a coarse initialization step that constructs an action-aware starting point, followed by a single-step local refinement that corrects residual errors. Concretely, the coarse stage learns a conditional posterior over endpoint velocity to transform Gaussian noise into a structured initialization, while the fine stage performs a fixed-time refinement from this initialization. To stabilize training, we introduce a stepwise strategy that first learns a controlled coarse predictor and then performs joint optimization. Experiments on CALVIN and LIBERO show that our method establishes a strong efficiency-performance frontier under low-NFE (Number of Function Evaluations) regimes: it consistently outperforms existing NFE=2 methods, matches or surpasses the NFE=10 $π_{0.5}$ baseline on several metrics, reduces action sampling latency by 75.4%, and achieves the best average real-robot success rate of 83.0%, outperforming MIP by 19.5 points and $π_{0.5}$ by 4.0 points. These results suggest that structured, coarse-to-fine generation enables both strong performance and efficient inference. Our code is available at https://github.com/EmbodiedAI-RoboTron/CF-VLA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。