轻量级视觉语言动作模型,无需机器人数据预训练即可实现高效高精度控制。
Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignment
- 基于原生多模态模型,引入跨模态扩散变换器与优化融合模块。
- 仅0.77亿参数,在Meta-World等3个基准上达顶尖性能,提升12.4%~6.9%。
- 训练不破坏视觉语言表征,适合资源受限场景的实时机器人部署。
视觉语言动作(VLA)模型通过统一感知、语言与控制,使机器人能完成多样化任务。但现有模型通常参数量巨大,依赖大规模机器人数据预训练,导致训练成本高、部署困难,且多数训练范式会削弱视觉语言主干的感知表征,引发过拟合与下游任务泛化能力差。本文提出Evo-1,一种轻量级VLA模型,在无需机器人数据预训练的前提下,降低计算开销并提升部署效率。Evo-1基于原生多模态视觉语言模型(VLM),引入新颖的跨模态扩散变压器与优化融合模块,构建有效架构。同时设计两阶段训练范式,逐步对齐动作与感知,保留VLM的表征能力。结果显示,仅含0.77亿参数的Evo-1在Meta-World和RoboTwin基准上分别超越前序最佳模型12.4%与6.9%,在LIBERO上达到94.8%的竞争力表现。真实世界评估中,其成功率高达78%,支持高频推理且内存开销低,优于所有基线方法。代码、数据与模型权重已开源,助力未来轻量化高效VLA研究。
原文摘要 · Abstract (English)
Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically contain massive parameters and rely heavily on large-scale robot data pretraining, leading to high computational costs during training, as well as limited deployability for real-time inference. Moreover, most training paradigms often degrade the perceptual representations of the vision-language backbone, resulting in overfitting and poor generalization to downstream tasks. In this work, we present Evo-1, a lightweight VLA model that reduces computation and improves deployment efficiency, while maintaining strong performance without pretraining on robot data. Evo-1 builds on a native multimodal Vision-Language model (VLM), incorporating a novel cross-modulated diffusion transformer along with an optimized integration module, together forming an effective architecture. We further introduce a two-stage training paradigm that progressively aligns action with perception, preserving the representations of the VLM. Notably, with only 0.77 billion parameters, Evo-1 achieves state-of-the-art results on the Meta-World and RoboTwin suite, surpassing the previous best models by 12.4% and 6.9%, respectively, and also attains a competitive result of 94.8% on LIBERO. In real-world evaluations, Evo-1 attains a 78% success rate with high inference frequency and low memory overhead, outperforming all baseline methods. We release code, data, and model weights to facilitate future research on lightweight and efficient VLA models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。