arXiv:2602.07399cs.AIcs.CV2026-02被引 6

用价值引导选动作块,让少样本视觉语言动作模型更准更稳。

VGAS: Value-Guided Action-Chunk Selection for Few-Shot Vision-Language-Action Adaptation

  • 推理时用多候选选择,挑出语义对且几何准的动作组合。
  • 在少样本下成功率提升,对相近动作的区分能力更强。
  • 适合做机器人控制等需要高精度动作的少样本任务。

视觉-语言-动作(VLA)模型连接多模态推理与物理控制,但面对少量示范的新任务时适应性仍不可靠。尽管微调后的VLA策略常生成语义合理的轨迹,失败往往源于未解决的几何模糊性——近似动作在有限监督下导致执行结果差异。本文从生成-选择视角研究少样本VLA适配,提出新框架VGAS(Value-Guided Action-chunk Selection)。它在推理阶段采用最佳N选一策略,识别语义忠实且几何精确的动作块。具体地,VGAS使用微调VLA作为高召回率生成器,并引入基于几何的Transformer判别器Q-Chunk-Former,以解决细粒度几何模糊。此外,提出显式几何正则化(EGR),构建具有区分性的价值景观,在稀疏监督下保持动作排名分辨力并抑制价值不稳定性。实验与理论分析表明,VGAS在少样本和分布偏移下均显著提升成功率与鲁棒性。代码已开源:https://github.com/Jyugo-15/VGAS。

原文摘要 · Abstract (English)

Vision--Language--Action (VLA) models bridge multimodal reasoning with physical control, but adapting them to new tasks with scarce demonstrations remains unreliable. While fine-tuned VLA policies often produce semantically plausible trajectories, failures often arise from unresolved geometric ambiguities, where near-miss actions lead to divergent execution outcomes under limited supervision. We study few-shot VLA adaptation from a \emph{generation--selection} perspective and propose a novel framework \textbf{VGAS} (\textbf{V}alue-\textbf{G}uided \textbf{A}ction-chunk \textbf{S}election). It performs inference-time best-of-$N$ selection to identify action chunks that are both semantically faithful and geometrically precise. Specifically, \textbf{VGAS} employs a finetuned VLA as a high-recall proposal generator and introduces the \textrm{Q-Chunk-Former}, a geometrically grounded Transformer critic to resolve fine-grained geometric ambiguities. In addition, we propose \textit{Explicit Geometric Regularization} (\texttt{EGR}), which shapes a discriminative value landscape to preserve action ranking resolution among near-miss candidates while mitigating value instability under scarce supervision. Experiments and theoretical analysis demonstrate that \textbf{VGAS} consistently improves success rates and robustness under limited demonstrations and distribution shifts. Our code is available at https://github.com/Jyugo-15/VGAS.

少样本学习动作选择几何建模VLA

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。