用轻量设计实现32赫兹实时机器人操作,仅需1GB显存。
TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM

- 跳过大模型直接连接视觉与语言,构建高效动作映射。
- 在LIBERO上达97.7%成功率,推理延迟仅31.2毫秒。
- 适合部署在消费级显卡的实时机器人系统应用。
视觉-语言-动作(VLA)模型通常采用以大语言模型为中心的 $V \to L \to A$ 流程,将视觉观测投影到大语言模型的表示空间后解码为机器人动作。尽管有效,该设计在每次策略调用时带来巨大计算和内存开销。本文提出TurboVLA,重构传统 $V \to L \to A$ 路径为直接的 $V + L \to A$ 映射。不再以大语言模型作为感知与动作之间的核心接口,TurboVLA独立编码视觉与语言信息,通过轻量级双向视觉-语言交互交换信息,并使用紧凑解码器预测连续动作片段。该设计从视觉与语言特征直接构建任务条件表示,显著降低VLA推理的计算与内存成本。在LIBERO数据集上,TurboVLA仅用0.2B参数、31.2毫秒推理延迟和0.9 GB显存,在RTX 4090上实现97.7%平均成功率,达到或超越更大规模的VLA策略。结果表明,TurboVLA是主流大模型中心范式的简洁高效替代,为视觉、语言与动作的高效联结提供新视角。代码已开源。
原文摘要 · Abstract (English)
Vision-language-action (VLA) models commonly adopt an LLM-centric $V \to L \to A$ pathway, where visual observations are projected into the representation space of a large language model before being decoded into robot actions. Although effective, this design incurs substantial computation and memory overhead at every policy invocation. In this work, we introduce TurboVLA, a new VLA paradigm that reformulates the conventional $V \to L \to A$ pathway as a direct $V + L \to A$ mapping. Instead of using a large language model as the central interface between perception and action, TurboVLA independently encodes visual observations and language instructions, directly exchanges information between them through lightweight bidirectional vision-language interaction, and predicts continuous action chunks with a compact decoder. This simple design constructs task-conditioned representations directly from visual and linguistic features, significantly reducing the computational and memory costs of VLA inference. On LIBERO, TurboVLA achieves 97.7% average success with only 0.2B parameters, 31.2 ms inference latency, and 0.9 GB inference VRAM on a consumer-grade RTX 4090, matching or outperforming substantially larger VLA policies. These results establish TurboVLA as a simple and effective alternative to the prevailing LLM-centric VLA paradigm, offering a new perspective on how vision, language, and action can be connected for efficient robotic manipulation. Code is available at https://github.com/H-EmbodVis/TurboVLA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。