arXiv:2605.10925cs.RO2026-05被引 4

让机器人模型在学习新任务时保留原有知识,提升泛化能力。

PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models

论文配图:PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models
图 1 · 摘自论文原文
  • 用冻结的先验专家保持预训练知识,仅微调部分参数。
  • 在少样本和分布外场景下性能超越全微调和现有模型。
  • 适用于真实机器人任务,仅需少量演示即可达到高成功率。

大规模预训练使视觉-语言-动作(VLA)模型成为通用机器人操作的基础,但下游任务适应仍需改进。传统全微调会改变广泛的先验知识,使其偏向训练数据分布。本文提出PriorVLA框架,通过冻结的先验专家作为只读先验源,训练一个适配专家进行下游任务特化。专家查询从预训练视觉语言模型获取场景先验,从先验专家获取运动先验,并融合至适配专家以指导适应。该方法仅更新全微调参数量的25%。在RoboTwin 2.0、LIBERO及真实世界任务中,PriorVLA表现优于全微调与先进VLA基线,尤其在分布外(OOD)和少样本设置下提升显著。在RoboTwin 2.0-Hard上比pi0.5高出11分,在LIBERO上平均成功率达99.1%。在8个真实任务、2种机械臂上,标准数据下实现81%(ID)和57%(OOD)成功率;每任务仅10次演示时,达48%(ID)和32%(OOD),分别领先pi0.5 24和22分。

原文摘要 · Abstract (English)

Large-scale pretraining has made Vision-Language-Action (VLA) models promising foundations for generalist robot manipulation, yet adapting them to downstream tasks remains necessary. However, the common practice of full fine-tuning treats pretraining as initialization and can shift broad priors toward narrow training-distribution patterns. We propose PriorVLA, a novel framework that preserves pretrained priors and learns to leverage them for effective adaptation. PriorVLA keeps a frozen Prior Expert as a read-only prior source and trains an Adaptation Expert for downstream specialization. Expert Queries capture scene priors from the pretrained VLM and motor priors from the Prior Expert, integrating both into the Adaptation Expert to guide adaptation. Together, PriorVLA updates only 25% of the parameters updated by full fine-tuning. Across RoboTwin 2.0, LIBERO, and real-world tasks, PriorVLA achieves stronger overall performance than full fine-tuning and state-of-the-art VLA baselines, with the largest gains under out-of-distribution (OOD) and few-shot settings. PriorVLA improves over pi0.5 by 11 points on RoboTwin 2.0-Hard and achieves 99.1% average success on LIBERO. Across eight real-world tasks and two embodiments, PriorVLA reaches 81% in-distribution (ID) and 57% OOD success with standard data. With only 10 demonstrations per task, PriorVLA reaches 48% ID and 32% OOD success, surpassing pi0.5 by 24 and 22 points, respectively.

机器人迁移学习少样本泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。