arXiv:2410.03132cs.ROcs.AI2024-10被引 42

用自回归序列建模统一机器人操作,提升跨任务泛化与效率。

Autoregressive Action Sequence Learning for Robotic Manipulation

  • 将机器人动作视为序列数据,用分块因果变压器实现多类型动作联合生成
  • 在多个机器人场景中性能超越或持平最先进方法,计算量更少、参数更精简
  • 适合需要通用控制架构的科研与工业应用,尤其关注高效实时控制

设计一种在多种机器人和任务配置下均表现良好的通用策略架构仍是关键挑战。本文将机器人动作表示为序列数据,通过自回归序列建模生成动作。现有自回归架构将末端执行器位姿作为语言模型中的词元逐个生成,仅适用于低频控制任务。而机器人动作具有异质性,常包含连续值如关节位置、2D像素坐标、末端位姿等,难以适配语言建模。为此,我们提出分块因果变压器(CCT),将单步预测扩展为可预测变长动作片段,支持不同动作类型使用不同分块大小。基于此,构建自回归策略(ARP),通过混合动作序列解决操作任务。在Push-T、ALOHA和RLBench等多个机器人操作环境中评估显示,ARP作为通用架构,在所有测试基准上达到或超过环境特异性最先进水平,同时计算效率更高、参数更少。真实机器人演示视频、全部源代码及预训练模型见http://github.com/mlzxy/arp。

原文摘要 · Abstract (English)

Designing a universal policy architecture that performs well across diverse robots and task configurations remains a key challenge. In this work, we address this by representing robot actions as sequential data and generating actions through autoregressive sequence modeling. Existing autoregressive architectures generate end-effector waypoints sequentially as word tokens in language modeling, which are limited to low-frequency control tasks. Unlike language, robot actions are heterogeneous and often include continuous values -- such as joint positions, 2D pixel coordinates, and end-effector poses -- which are not easily suited for language-based modeling. Based on this insight, we introduce a straightforward enhancement: we extend causal transformers' single-token prediction to support predicting a variable number of tokens in a single step through our Chunking Causal Transformer (CCT). This enhancement enables robust performance across diverse tasks of various control frequencies, greater efficiency by having fewer autoregression steps, and lead to a hybrid action sequence design by mixing different types of actions and using a different chunk size for each action type. Based on CCT, we propose the Autoregressive Policy (ARP) architecture, which solves manipulation tasks by generating hybrid action sequences. We evaluate ARP across diverse robotic manipulation environments, including Push-T, ALOHA, and RLBench, and show that ARP, as a universal architecture, matches or outperforms the environment-specific state-of-the-art in all tested benchmarks, while being more efficient in computation and parameter sizes. Videos of our real robot demonstrations, all source code and the pretrained models of ARP can be found at http://github.com/mlzxy/arp.

机器人操作自回归建模通用策略序列生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。