arXiv:2606.07383cs.ROcs.LG2026-06

轻量化视觉语言动作模型,实现在边缘设备上11.69帧/秒的实时机器人控制。

RhinoVLA Technical Report

论文配图:RhinoVLA Technical Report
图 1 · 摘自论文原文
  • 采用高效视觉编码与连续动作专家,减少视觉令牌数量和计算量。
  • 在相同参数规模下性能接近π0.5,边缘设备实现11.69赫兹端到端推理。
  • 支持异构机器人共享策略,适合边缘部署与多机器人协同场景。

视觉-语言-动作(VLA)模型在机器人操作中展现出巨大潜力,但其在边缘硬件上的实时部署仍具挑战性。本文发现,当模型维度固定时,基于GEMM的投影算子计算量随输入令牌数线性增长,成为主要延迟来源。为此,我们提出RhinoVLA,一种面向部署的VLA模型,与华曦R1边缘SoC协同设计。RhinoVLA采用令牌高效的Qwen3-VL骨干网络与连续动作专家,减轻视觉语言模型侧的令牌负担与计算开销,同时保持预训练多模态能力。为支持跨机器人学习,RhinoVLA引入统一接口,融合视图注册表、72维物理状态-动作槽空间与机器人实例LoRA,实现异构机器人观测与动作模式的对齐。部署方面,通过硬件感知编译、混合精度执行与并行视觉编码优化。实验表明,RhinoVLA在相似参数规模下性能媲美π0.5,且在华曦R1上实现11.69赫兹端到端推理,满足10赫兹实时闭环控制需求。项目将开源至https://github.com/HuixiAI/RhinoVLA。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models have shown strong potential for robotic manipulation, but real-time deployment on edge hardware remains challenging. In this work, we identify VLM visual and context tokens as a major source of deployment latency: for GEMM-dominated projection operators, computation grows linearly with the number of input tokens when model dimensions are fixed. Motivated by this observation, we propose RhinoVLA, a deployment-oriented VLA model co-designed with the Huixi R1 edge SoC. RhinoVLA adopts a token-efficient Qwen3-VL backbone and a continuous Action Expert, reducing the VLM-side token and computation burden while preserving pretrained multimodal capability. To support cross-robot learning, RhinoVLA further introduces a unified interface that combines View Registry, 72D physical state-action slot space, and robotinstance LoRA, allowing heterogeneous robot observations and action schemas to be aligned under a shared policy. On the deployment side, RhinoVLA is optimized through hardware-aware compilation, mixed-precision execution, and parallel visual encoding. Experiments show that RhinoVLA achieves downstream performance comparable to π0.5 at a similar parameter scale, while reaching 11.69 Hz end-to-end inference on Huixi R1, meeting the 10 Hz real-time closedloop control target. The project will be open-sourced at https://github.com/HuixiAI/RhinoVLA.

机器人控制边缘计算轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。