arXiv:2606.21493cs.CVcs.ET2026-06被引 2

用少量带动作标签数据,让机器人学会在新环境中听懂指令并正确执行任务。

Semi-Supervised Vision-Language-Action Model

论文配图:Semi-Supervised Vision-Language-Action Model
图 1 · 摘自论文原文
  • 通过自蒸馏框架从无动作标注的视觉语言数据中生成可靠伪动作。
  • 在10%标注数据下,平均成功率提升至89.0%,比监督方法高8.0个百分点。
  • 特别适合资源受限场景下机器人技能快速迁移与低成本部署。

视觉-语言-动作(VLA)模型使机器人能直接从视觉观测和语言指令中预测动作,但适应新环境仍依赖昂贵的动作标注示范。为减少这一依赖,本文研究在有限监督下的半监督VLA适配:仅少数轨迹包含机器人动作,其余为无动作标注的视觉-语言观测。不同于标准半监督学习,缺失的监督信号是需视觉对齐、语言一致、物理可行且时间稳定的具身动作。为此,提出SemiVLA,一种自蒸馏教师-学生框架,利用无标注轨迹上的可靠伪动作进行学习。SemiVLA引入VLA特有可靠性控制器,评估视觉-语言对齐性、动作可行性与时间过渡一致性,并通过瓶颈投影对齐更新教师,避免噪声反馈污染。以OpenVLA为骨干,在LIBERO与CALVIN上均显著优于多种参数高效微调策略。在10%标注轨迹下,采用选择性LoRA的SemiVLA达到89.0%平均成功率,较监督LoRA提升8.0个百分点,且无额外推理开销。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) models enable robots to predict actions directly from visual observations and language instructions, but adapting them to new environments still depends on costly action-labeled demonstrations. To reduce this dependence, we study semi-supervised VLA adaptation under limited supervision signals, where only a small portion of trajectories contain robot actions and the remaining trajectories provide action-unlabeled vision-language observations. Unlike standard semi-supervised learning, the missing supervision is an embodied action signal that must be visually grounded, language-consistent, physically feasible, and temporally stable. To address this problem, we propose SemiVLA, a self-distilled teacher-student framework that learns from reliable pseudo-actions on unlabeled trajectories. SemiVLA introduces a VLA-specific reliability controller to assess vision-language alignment, action feasibility, and temporal transition consistency, and further updates the teacher through a Bottleneck-Projected Alignment Update to avoid noisy feedback contamination. With OpenVLA as the backbone, SemiVLA consistently improves multiple PEFT strategies across LIBERO and CALVIN. Under 10\% labeled trajectories, SemiVLA with Selective LoRA achieves 89.0\% average success on LIBERO, outperforming supervised LoRA by 8.0 points without extra inference cost.

机器人学习半监督视觉语言动作参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。