arXiv:2608.02547cs.RO2026-08被引 3

动作分块提升机器人控制性能,关键在于隐式集成多样性时序关系。

Why Does Action Chunking Improve Behavioral Cloning Performance in Robotic Control?

论文配图:Why Does Action Chunking Improve Behavioral Cloning Performance in Robotic Control?
图 1 · 摘自论文原文
  • 通过隐式集成多个时序依赖关系,提升策略表达能力。
  • 相比单步预测,动作分块显著减少误差累积,提升鲁棒性。
  • 无需显式分块,随机延迟的策略集成即可达到同等效果。

动作分块——即一次预测并执行多个动作——已被证明是学习高效机器人控制策略的关键。然而,其为何能提升性能仍缺乏清晰理解。本文在模拟与真实场景中进行严格实验,发现现有解释(时间一致性、视野缩减、表征学习)均无法充分说明其成功原因。相反,我们发现动作分块的优势源于更强的非马尔可夫表达能力与更少的误差累积,而这些效果可通过延迟策略(每步基于k步前观测预测单个动作)完全实现。此外,我们揭示了一种新机制:隐式集成。动作分块策略学习多种时序关系(如a_t|o_t, a_t|o_{t-1}…),其行为类似模型集成,增强泛化能力。基于此,我们提出一种显式集成策略,通过构建多延迟策略集,在多个仿真与真实机器人任务中超越传统动作分块方法。

原文摘要 · Abstract (English)

Action chunking---predicting and executing multiple actions instead of a single action---has proven to be a critical component for learning effective robotic control policies. However, our precise understanding of why action chunking improves performance has remained limited. In this work we seek to close this gap. Through rigorous experimental evaluations in both simulated and real-world settings, we show that existing hypotheses for the success of action chunking---temporal consistency, horizon reduction, and representation learning---fail to explain the success of action chunking. Instead, we find that action chunking benefits from greater non-Markovian expressivity and reduced compounding error compared to Markovian policies, but, in many settings of interest, these effects can be fully captured by delayed policies, which at each step predict a single action based on the observation $k$ steps in the past. We then show that there exists an additional benefit of action chunking that we refer to as implicit ensembling. In particular, by learning a diversity of temporal relationships (that is, $a_t | o_t, a_t | o_{t-1}, \ldots$), action-chunked policies exhibit behavior matching that of a model ensemble, increasing their robustness and generalization ability over policies that only learn a single temporal relationship. Building on these insights, we show that in simulated and real-world robotic control settings, we can match the performance of action chunking without action chunking---by deploying an action chunking policy as an ensemble of policies with randomized delays. Furthermore, we propose a policy class that amplifies the benefits of action chunking by explicitly instantiating an ensemble, and which we show significantly improves over the performance of action chunking in many domains.

机器人控制动作分块策略集成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。