arXiv:2506.06072cs.ROcs.LG2025-06NeurIPS被引 21

用B样条编码动作序列,实现高效平滑的模仿学习

BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learning

  • 用B样条将动作序列转为紧凑离散或连续令牌
  • 训练和推理成本更低,生成动作更平滑且成功率高
  • 兼容多种大模型,适合真实机器人控制任务

我们提出B样条编码动作序列分词器(BEAST),一种基于B样条的新颖动作分词方法,可将动作序列编码为紧凑的离散或连续令牌。与依赖向量量化或字节对编码的现有分词器不同,BEAST无需单独训练分词器,始终生成等长令牌,支持通过并行解码实现快速动作序列生成。借助B样条公式,BEAST天然保证相邻段之间无间断,生成平滑轨迹。我们将BEAST集成到三种不同架构中进行评估:带有连续令牌的变分自编码器(VAE)、使用离散令牌的仅解码器Transformer,以及采用编码器-解码器结构的预训练视觉语言模型Florence-2,验证其与大型预训练模型的兼容性和可扩展性。在包含166个模拟任务的三个基准测试及涵盖8个真实世界任务的三种机器人设置上进行实验,结果表明,BEAST(i)显著降低训练与推理计算开销,(ii)持续生成适用于连续控制任务的高频率平滑控制信号,(iii)在任务成功率上可靠达到与最先进方法相当的水平。

原文摘要 · Abstract (English)

We present the B-spline Encoded Action Sequence Tokenizer (BEAST), a novel action tokenizer that encodes action sequences into compact discrete or continuous tokens using B-splines. In contrast to existing action tokenizers based on vector quantization or byte pair encoding, BEAST requires no separate tokenizer training and consistently produces tokens of uniform length, enabling fast action sequence generation via parallel decoding. Leveraging our B-spline formulation, BEAST inherently ensures generating smooth trajectories without discontinuities between adjacent segments. We extensively evaluate BEAST by integrating it with three distinct model architectures: a Variational Autoencoder (VAE) with continuous tokens, a decoder-only Transformer with discrete tokens, and Florence-2, a pretrained Vision-Language Model with an encoder-decoder architecture, demonstrating BEAST's compatibility and scalability with large pretrained models. We evaluate BEAST across three established benchmarks consisting of 166 simulated tasks and on three distinct robot settings with a total of 8 real-world tasks. Experimental results demonstrate that BEAST (i) significantly reduces both training and inference computational costs, and (ii) consistently generates smooth, high-frequency control signals suitable for continuous control tasks while (iii) reliably achieves competitive task success rates compared to state-of-the-art methods.

模仿学习动作生成B样条机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。