用反向推理生成机器人操作轨迹,提升泛化能力。
Chain-of-Action: Trajectory Autoregressive Modeling for Robotic Manipulation
- 从任务目标反推动作序列,全局约束局部动作。
- 在60个RLBench任务和8个真实场景中达到顶尖性能。
- 适合需要高精度与强泛化的机器人控制研究者。
我们提出链式动作(Chain-of-Action, CoA),一种基于轨迹自回归建模的新型视觉-运动策略。不同于传统方法向前预测下一步动作,CoA通过动作级思维链(CoT)过程,以任务目标为起点进行反向推理,生成完整动作轨迹。该过程统一于单一自回归结构:首项为编码任务目标的稳定关键帧动作;后续动作项则基于初始关键帧及先前预测动作逐步生成。这种反向推理构建了自上而下的结构,使每个局部动作都受最终目标严格约束。为实现该推理结构,CoA引入四项互补设计:连续动作标记表示、动态停止机制以支持可变长度轨迹生成、逆时序集成,以及多标记预测以平衡动作块建模与全局结构。实验表明,CoA在60个RLBench任务和8个真实世界操作任务中均达到当前最优性能,兼具强大的空间泛化能力,同时保持视觉-运动策略的灵活性与简洁性。
原文摘要 · Abstract (English)
We present Chain-of-Action (CoA), a novel visuo-motor policy paradigm built upon Trajectory Autoregressive Modeling. Unlike conventional approaches that predict next step action(s) forward, CoA generates an entire trajectory by explicit backward reasoning with task-specific goals through an action-level Chain-of-Thought (CoT) process. This process is unified within a single autoregressive structure: (1) the first token corresponds to a stable keyframe action that encodes the task-specific goals; and (2) subsequent action tokens are generated autoregressively, conditioned on the initial keyframe and previously predicted actions. This backward action reasoning enforces a global-to-local structure, allowing each local action to be tightly constrained by the final goal. To further realize the action reasoning structure, CoA incorporates four complementary designs: continuous action token representation; dynamic stopping for variable-length trajectory generation; reverse temporal ensemble; and multi-token prediction to balance action chunk modeling with global structure. As a result, CoA gives strong spatial generalization capabilities while preserving the flexibility and simplicity of a visuo-motor policy. Empirically, we observe CoA achieves the state-of-the-art performance across 60 RLBench tasks and 8 real-world manipulation tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。