arXiv:2605.30695cs.RO2026-05

让视觉语言动作模型通过少量示范学会新任务,关键在学习基础动作单元。

Primitive Subspaces Mediate Few-Shot Transfer in VLAs

  • 训练时分解任务为基础动作片段,用语言提示引导模型学习可组合的子技能。
  • 仅需3次示范即达微调模型78%性能,比传统方法少用7次示范,效率提升3倍。
  • 发现基础动作表征是迁移能力的关键,不学它就无法快速适应新任务。

在工业场景中部署视觉-语言-动作(VLA)策略需低成本教授新任务,但现有VLA缺乏此能力,因每项新任务都需微调。本文探究是否通过包含基础动作的训练能生成可迁移的技能库:即在推理时仅用少量示范即可组合这些子技能完成未训练过的任务。我们在相同微调方案和固定超参数下,用两种具有不同归纳偏置的VLA架构(OpenVLA 和 $π_{0.5}$)在接触密集的组装数据集 REASSEMBLE 上训练,对比平坦轨迹与基于基础动作分段的剧集,并使用针对特定动作的语言提示。我们保留6种物体-任务组合用于测试,评估少样本迁移能力:模型接收 $m \in \{0, 1, 3, 5, 10\}$ 次示范后尝试执行,不进行权重更新。实验在三个训练种子上重复,并在另一数据集 LIBERO-Long 上验证。结果显示,基于基础动作训练的模型仅需3次示范即达到微调上限性能的78%,而平坦训练模型需10次才能达到同等水平——样本效率差距达3倍,且该结果在种子、架构和数据集间均稳定复现。为进一步确立因果关系,我们对隐藏状态中的基础动作可解码子空间进行消融,发现少样本迁移性能下降32个百分点;而随机同维子空间消融则无影响,表明基础动作表示是迁移能力的因果必要条件。此外,我们识别并修正了一种方法学缺陷:评估分段策略时,全家族动作范围门控的累积效应导致误失败率高出一个数量级,显著高于真实人类示范的表现。

原文摘要 · Abstract (English)

Deploying vision-language-action (VLA) policies in industrial environments requires the ability to teach new tasks at low cost, a property current VLAs lack, since each new task requires fine-tuning. We investigate whether primitive-aware training produces a transferable artifact: a learned library of sub-skills that can be composed at inference time, conditioned on a small number of demonstrations, to perform tasks the policy was never trained on. We train two VLA architectures with different inductive biases, OpenVLA and $π_{0.5}$, on the REASSEMBLE contact-rich assembly dataset under matched LoRA fine-tuning recipes and locked hyperparameters, varying training between flat trajectories and primitive-segmented episodes with primitive-specific language prompts. We hold out 6 object-task combinations from training and evaluate few-shot transfer: models receive $m \in \{0, 1, 3, 5, 10\}$ demonstrations of a held-out task and attempt execution without weight updates. We replicate across three training seeds and validate on a second dataset (LIBERO-Long). Primitive-trained models reach 78% of fine-tuned upper-bound performance with only m=3 demonstrations, while flat-trained models require m=10 demonstrations to reach the same level -- a $3\times$ sample efficiency gap that replicates across seeds, architectures, and datasets. To establish causation, we ablate the primitive-decodable subspace of hidden states and show few-shot transfer degrades by 32 percentage points while ablating a random subspace of equal dimensionality has no effect, indicating primitive representations are causally necessary rather than incidentally correlated with transfer. We identify and correct a methodological pitfall in evaluating chunked policies: family-wise inflation of single-step action-range gates produces order-of-magnitude higher false-failure rates against ground-truth human demonstrations.

少样本迁移动作分解视觉语言动作技能组合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。