arXiv:2607.04171cs.ROcs.LG2026-07

让小模型学会看位置、有结构地动,提升机器人操作能力。

Teaching Tiny VLA Models Where to Look and How to Move

论文配图:Teaching Tiny VLA Models Where to Look and How to Move
图 1 · 摘自论文原文
  • 用大模型教小模型看关键位置,无须人工标注。
  • 在真实任务中成功率从21.7%提至65.0%,在基准上达90.3%。
  • 适合资源受限的实时机器人控制场景。

Tiny Vision-Language-Action(VLA)模型适用于实时机器人控制,但模型缩小常削弱任务相关的空间定位与连贯动作生成能力。本文提出XS-VLA轻量框架,通过不增加部署成本的方式教会小模型“看哪里”和“如何动”。空间定位方面,采用粗粒度空间蒸馏(Coarse-Grained Spatial Distillation),利用Qwen3-VL-4B生成任务相关物体的粗略图像平面标签,量化为空间词汇并蒸馏至SmolVLM2-0.25B主干网络,无需人工标注。动作生成方面,引入潜变量流匹配(Latent Flow Matching),结合条件变分自编码器(CVAE)式潜变量与基于流的策略学习,在训练中组织多模态示范,部署时生成稳定动作块。在LIBERO数据集上,XS-VLA将平均成功率从82.8%提升至90.3%,在LIBERO-Long上从63.0%提升至89.0%。真实世界实验设计三项任务:单臂放置、精准双臂堆叠与长序列协调,成功率达21.7%提升至65.0%。结果表明,显式空间定位与潜动作结构学习可显著增强小型VLA模型的机器人操作能力。

原文摘要 · Abstract (English)

Tiny Vision-Language-Action models are appealing for real-time robotic control, but reducing model scale often weakens two capabilities essential for manipulation: task-conditioned spatial grounding and coherent action generation. We introduce XS-VLA, a lightweight framework that teaches tiny VLA policies "where to look" and "how to move" without increasing deployment-time model cost. For spatial grounding, Coarse-Grained Spatial Distillation uses Qwen3-VL-4B to produce teacher-derived coarse image-plane location labels for task-relevant objects, which are quantized into a spatial vocabulary and distilled into a SmolVLM2-0.25B backbone without human annotations. For action generation, Latent Flow Matching combines a CVAE-style latent variable with flow-based policy learning to organize multimodal demonstrations during training and produce stable action chunks at deployment. On LIBERO, XS-VLA improves average success from 82.8\% to 90.3\% over SmolVLA-0.25B and improves LIBERO-Long from 63.0\% to 89.0\%. In real-world experiments, we design three tasks covering single-arm placement, precision bimanual stacking, and long-horizon sequential coordination, where XS-VLA improves average task success from 21.7\% to 65.0\%. These results show that explicit spatial grounding and latent action-structure learning can make tiny VLA models effective for robotic manipulation.

机器人操作小模型空间定位动作生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。