arXiv:2605.25547cs.ROcs.CV2026-05被引 1

通过推理时采样提升机器人操作性能,无需微调策略模型。

TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation

论文配图:TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation
图 1 · 摘自论文原文
  • 用动作-变分自编码器在低维隐空间生成多组候选动作
  • 基于任务进展预测验证动作,选出最可能成功的方案
  • 适用于各类通用策略,真实与仿真环境均显著提效

现有具身控制研究通过扩大训练数据和模型规模取得了显著性能提升。本文探索推理时策略作为另一优化方向。非确定性生成模型如扩散模型和自回归模型已被广泛用于具身控制,但单次推理范式限制了其性能。本文提出一种即插即用的推理时采样框架 TapSampling。首先引入动作-变分自编码器(Action-VAE),将策略生成的初始动作映射到压缩后验分布,从中可任意采样低维隐变量并解码为近似真实动作分布的候选动作。其次,将动作验证建模为任务进展预测,利用机器人数据集的内在序列结构训练一个语义上合理的验证器,实现可解释的动作选择。此外,TapSampling 具有策略无关性。大量仿真与真实世界实验表明,该方法在不进行策略微调的前提下,显著提升了多个通用策略的性能。代码与模型已公开。

原文摘要 · Abstract (English)

Existing embodied control research demonstrates remarkable performance improvements by scaling training data and model size. We instead explore inference-time strategy as an alternative axis. Non-deterministic generative models, such as diffusion and autoregressive models, have been widely adopted in the field of embodied control. However, the single-shot inference paradigm limits their performance. In this paper, we propose \textbf{TapSampling}, a plug-and-play framework for inference-time sampling. First, we introduce an Action-VAE that represents actions in a low-dimensional latent space by mapping policy-generated initial actions into a compressed posterior distribution, from which any number of latent samples can be drawn and decoded into candidate actions that approximate the true action distribution. Second, we formulate action verification as task-progress outcome prediction, using the intrinsic sequential structure of robotic datasets to train a semantically grounded verifier for interpretable action selection. Furthermore, TapSampling is a policy-agnostic framework. Extensive experiments in both simulated and real-world environments demonstrate that our method substantially improves multiple generalist policies without further policy finetuning. Code and models are available at the project page.

机器人操作推理采样生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。