arXiv:2509.09372cs.RO2025-09AAAI被引 144

用轻量模块让小模型高效连接视觉语言与动作,无需大量数据和算力。

VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model

论文配图:VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
图 1 · 摘自论文原文
  • 设计轻量策略,通过桥接注意力自动选择最优感知条件。
  • 仅用0.5B参数和单卡8小时训练,性能达顶尖水平。
  • 适合资源有限但需快速部署智能机器人系统的团队。

视觉-语言-动作(VLA)模型通常通过在机器人数据上预训练大规模视觉-语言模型(VLM)来连接感知与动作空间。尽管该方法显著提升性能,但也带来高昂的训练成本。本文研究如何有效将视觉-语言表示映射到动作空间,提出VLA-Adapter新范式,减少对大尺度VLM和大量预训练的依赖。我们系统分析了多种视觉-语言条件的有效性,发现关键条件对打通感知与动作至关重要。基于此,提出轻量级策略模块,采用桥接注意力机制,自主注入最优条件至动作空间。该方法仅使用0.5亿参数骨干网络,无需机器人数据预训练,即可实现顶尖性能。在仿真与真实机器人基准测试中,VLA-Adapter不仅达到当前最佳表现,还具备最快推理速度。此外,得益于先进的桥接机制,其在单个消费级GPU上仅需8小时即可完成训练,大幅降低部署门槛。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models typically bridge the gap between perceptual and action spaces by pre-training a large-scale Vision-Language Model (VLM) on robotic data. While this approach greatly enhances performance, it also incurs significant training costs. In this paper, we investigate how to effectively bridge vision-language (VL) representations to action (A). We introduce VLA-Adapter, a novel paradigm designed to reduce the reliance of VLA models on large-scale VLMs and extensive pre-training. To this end, we first systematically analyze the effectiveness of various VL conditions and present key findings on which conditions are essential for bridging perception and action spaces. Based on these insights, we propose a lightweight Policy module with Bridge Attention, which autonomously injects the optimal condition into the action space. In this way, our method achieves high performance using only a 0.5B-parameter backbone, without any robotic data pre-training. Extensive experiments on both simulated and real-world robotic benchmarks demonstrate that VLA-Adapter not only achieves state-of-the-art level performance, but also offers the fast inference speed reported to date. Furthermore, thanks to the proposed advanced bridging paradigm, VLA-Adapter enables the training of a powerful VLA model in just 8 hours on a single consumer-grade GPU, greatly lowering the barrier to deploying the VLA model. Project page: https://vla-adapter.github.io/.

机器人轻量模型视觉语言高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。