arXiv:2606.31132cs.RO2026-06

让生成式机器人策略自动分配测试时算力,提升控制精度与效率。

ELASTIC: Efficiently Learning to Adaptively Scale Test-Time Compute for Generative Control Policies

论文配图:ELASTIC: Efficiently Learning to Adaptively Scale Test-Time Compute for Generative Control Policies
图 1 · 摘自论文原文
  • 通过强化学习动态规划每步的串行去噪与并行采样数量
  • 在相同算力下比固定分配方式成功率更高,真实机器人上延迟降34%
  • 适合需要高精度、低延迟的机器人任务,如抓取与操作

生成式控制策略(如扩散策略和基于流的视觉-语言-动作模型)支持机器人控制中的测试时算力扩展。算力可沿两个维度分配:串行扩展(增加去噪步数以精炼动作)和并行扩展(多采样候选动作以探索策略分布的不同模式)。然而,最优算力分配难以预先确定,因其依赖于状态、任务和策略本身。例如,抓取初期适合更广的并行探索,而接近接触阶段则需更多串行优化以保证精度。本文提出ELASTIC算法,学习状态相关的测试时算力调度策略。将算力分配建模为元马尔可夫决策过程,其中元策略在每步去噪迭代中选择串行步数与并行样本数,以最大化任务成功率并最小化算力消耗。该元策略使用强化学习训练,无需访问生成式控制策略的训练数据。在扩散策略的模拟操作基准测试中,ELASTIC在相同算力预算下帕累托优于固定分配与单轴扩展基线。在真实机器人上使用$π_{0.5}$视觉-语言-动作模型时,其成功率达到最佳10次采样平均水平,同时减少34%的墙钟延迟。

原文摘要 · Abstract (English)

Generative control policies (GCPs), such as diffusion policies and flow-based vision-language-action models, enable test-time scaling in robot control. Test-time compute can be allocated along two axes: sequential scaling, which increases denoising steps to refine actions, and parallel scaling, which samples multiple candidate actions to search across modes of the policy distribution. However, the optimal allocation of sequential and parallel compute is hard to know a priori as it is state-, task-, and policy-dependent. For example, early stages of a grasp may benefit from broader parallel exploration, while near-contact phases may require more sequential refinement for precision. We present ELASTIC, an algorithm that learns state-dependent test-time compute schedules for GCPs. We formulate compute allocation as a meta-Markov Decision Process in which a meta-policy interacts with a frozen pretrained robot policy and selects sequential steps and parallel samples at each denoising iteration to maximize task success while minimizing compute. Using reinforcement learning, this meta-policy also learns adaptive compute schedules without access to the GCP's training data. Across simulated manipulation benchmarks with diffusion policies, ELASTIC Pareto-dominates fixed and single-axis scaling baselines at matched compute budgets. On real-world robot manipulation with the $π_{0.5}$ vision-language-action model, ELASTIC matches best-of-$10$ success while reducing wall-clock latency by 34%.

机器人控制生成式策略测试时计算强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。