arXiv:2602.21684cs.ROcs.LG2026-02

将动作生成分两阶段,提升机器人模仿学习的稳定性和精细度。

Primary-Fine Decoupling for Action Generation in Robotic Imitation

  • 先选粗粒度动作模式,再生成精细连续动作,避免模式跳变。
  • 在56个任务上超越现有方法,实测可应用于真实触觉操作。
  • 适合需要高精度与稳定性的机器人操控场景。

机器人操作动作序列具有多模态分布,给模仿学习带来挑战。现有方法通常将动作空间建模为离散令牌或连续潜变量分布,但各有缺陷:离散化会丢失细微动作差异,单阶段连续生成易导致模式跳变不稳定。为此,本文提出一种两阶段框架PF-DAG,将粗粒度动作一致性与细粒度变化解耦。首先将动作片段压缩为少量离散模式,由轻量策略选择一致模式以避免模式振荡;其次,基于模式条件的MeanFlow策略生成高保真连续动作。理论上证明,该两阶段设计的均方误差下界严格低于单阶段生成策略。实验上,PF-DAG在Adroit、DexArt和MetaWorld共56个任务中优于当前最优基线,并成功泛化至真实世界触觉灵巧操作任务。结果表明,显式模式解耦可同时实现鲁棒多模态建模与反应式闭环控制。

原文摘要 · Abstract (English)

Multi-modal distribution in robotic manipulation action sequences poses critical challenges for imitation learning. To this end, existing approaches often model the action space as either a discrete set of tokens or a continuous, latent-variable distribution. However, both approaches present trade-offs: some methods discretize actions into tokens and therefore lose fine-grained action variations, while others generate continuous actions in a single stage tend to produce unstable mode transitions. To address these limitations, we propose Primary-Fine Decoupling for Action Generation (PF-DAG), a two-stage framework that decouples coarse action consistency from fine-grained variations. First, we compress action chunks into a small set of discrete modes, enabling a lightweight policy to select consistent coarse modes and avoid mode bouncing. Second, a mode conditioned MeanFlow policy is learned to generate high-fidelity continuous actions. Theoretically, we prove PF-DAG's two-stage design achieves a strictly lower MSE bound than single-stage generative policies. Empirically, PF-DAG outperforms state-of-the-art baselines across 56 tasks from Adroit, DexArt, and MetaWorld benchmarks. It further generalizes to real-world tactile dexterous manipulation tasks. Our work demonstrates that explicit mode-level decoupling enables both robust multi-modal modeling and reactive closed-loop control for robotic manipulation.

机器人模仿动作生成多模态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。