动态调整机器人动作执行时长,提升复杂操作成功率。
Dynamic Execution Horizon Prediction for Chunk-based Robot Policies

- 训练轻量级预测分支,实时决定动作块执行时长。
- 在高精度长周期任务中成功率显著提升,最高达37%。
- 适合需要灵活响应的精细操作场景,兼容现有模型。
动作分块已成为现代机器人策略的标准设计,从扩散/流模型到视觉-语言-动作模型均采用此方式,即策略预测一串动作并执行固定数量,而非逐步执行。然而该范式依赖于固定执行时长的假设,在分块执行期间策略处于开环状态,对需要频繁重规划的精细操作尤为不利。实践中,执行时长通常通过经验调优,且高度依赖任务。为此,我们提出动态执行时长预测(DEHP),通过在线强化学习训练一个轻量级的执行时长预测分支,同时保持预训练的动作分块策略完全冻结。该方法兼容黑箱分块策略,并将执行时长调整与底层动作生成器解耦。在多项评估中,DEHP显著提升了多种高精度、长时序操作任务的成功率。定性分析表明,任务精细阶段预测较短执行时长,自由空间运动阶段则预测较长时长。由此,DEHP在开环执行效率与闭环单步控制反应性之间取得平衡。项目页:https://dehp-chunking.github.io/
原文摘要 · Abstract (English)
Action chunking has become a standard design in modern robot policies, from diffusion/flow policies to vision-language-action models, where the policy predicts a sequence of actions and executes a fixed number of them instead of acting one step at a time. However, this paradigm relies on a key assumption: a fixed execution horizon. During chunk execution, the policy operates open-loop, which is particularly problematic for fine-grained manipulation tasks that require frequent replanning. In practice, the execution horizon is typically chosen through empirical tuning and is highly task-dependent. To this end, we propose Dynamic Execution Horizon Prediction (DEHP), an effective method that trains a lightweight execution-horizon prediction branch using online reinforcement learning while keeping the pretrained chunk policy completely frozen. This makes the method compatible with black-box chunk policies and isolates the effect of adapting the execution horizon from changes to the underlying action generator. Across our evaluations, DEHP improves the success rate of different high-precision and long-horizon manipulation tasks by a large margin. Our qualitative analysis further shows that DEHP predicts shorter execution horizons during fine-grained stages of the task and longer horizons during free-space motion. In this way, DEHP balances the efficiency of open-loop chunk execution with the reactivity of closed-loop single-step control. Project page: https://dehp-chunking.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。