arXiv:2603.27281cs.RO2026-03被引 2

无需分词的连续动作建模,提升机器人策略学习效率与精度

HiFlow: Tokenization-Free Scale-Wise Autoregressive Policy Learning via Flow Matching

  • 直接处理连续动作,避免离散分词带来的量化误差
  • 多尺度时间池化构建粗细动作目标,端到端训练一次完成
  • 在模拟与真实环境均超越扩散模型和分词方法

近期基于粗粒度到细粒度的自回归建模在视觉-运动策略学习中展现出强大潜力,兼具自回归方法的推理效率与基于扩散模型的全局轨迹一致性。然而,现有方法依赖将连续动作序列映射到代码本索引的离散动作分词器,这一设计源于图像生成任务中对高维像素数据的压缩需求。我们观察到机器人动作本身是低维连续向量,分词引入了不必要的量化误差,并导致多阶段训练流程。为此,本文提出层级流策略(HiFlow),一种无需分词的粗粒度到细粒度自回归策略,直接作用于原始连续动作。HiFlow通过简单的时序池化从每个动作片段构造多尺度连续动作目标:对相邻动作窗口求平均,生成粗粒度摘要,并在更精细的时间分辨率上逐步细化。整个模型以单阶段端到端方式训练,无需独立分词器。在MimicGen、RoboTwin 2.0及真实环境中的实验表明,HiFlow始终优于现有方法,包括基于扩散模型和分词的自回归策略。

原文摘要 · Abstract (English)

Coarse-to-fine autoregressive modeling has recently shown strong promise for visuomotor policy learning, combining the inference efficiency of autoregressive methods with the global trajectory coherence of diffusion-based policies. However, existing approaches rely on discrete action tokenizers that map continuous action sequences to codebook indices, a design inherited from image generation where learned compression is necessary for high-dimensional pixel data. We observe that robot actions are inherently low-dimensional continuous vectors, for which such tokenization introduces unnecessary quantization error and a multi-stage training pipeline. In this work, we propose Hierarchical Flow Policy (HiFlow), a tokenization-free coarse-to-fine autoregressive policy that operates directly on raw continuous actions. HiFlow constructs multi-scale continuous action targets from each action chunk via simple temporal pooling. Specifically, it averages contiguous action windows to produce coarse summaries that are refined at finer temporal resolutions. The entire model is trained end-to-end in a single stage, eliminating the need for a separate tokenizer. Experiments on MimicGen, RoboTwin 2.0, and real-world environments demonstrate that HiFlow consistently outperforms existing methods including diffusion-based and tokenization-based autoregressive policies.

机器人策略自回归流匹配连续控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。