arXiv:2412.12953cs.LGcs.RO2024-12ICLR被引 58

用专家混合提升扩散策略效率,134任务表现超前且推理快90%。

Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learning

  • 引入噪声条件路由的专家混合结构,稀疏激活降低计算开销。
  • 在4个基准上平均性能提升57%,仅用10%的浮点运算量。
  • 适合需要高效多任务机器人学习的研究者与开发者。

扩散策略在模仿学习中广泛应用,具备生成多模态、非连续行为的优点。然而,随着模型规模增大,计算需求呈指数增长,形成瓶颈。为此,我们提出一种新型策略——噪声去噪专家混合(MoDE),通过稀疏专家结构和噪声条件路由,在保持高性能的同时实现参数高效扩展。相比标准扩散变压器架构,主动参数减少40%,推理成本降低90%(得益于专家缓存)。其结合噪声条件自注意力机制,可在不同噪声水平下更有效地去噪。在四个主流模仿学习基准(CALVIN 和 LIBERO)的134个任务上达到最先进性能:预训练后在 CALVIN ABC 上达4.01,在 LIBERO-90 上达0.95。平均超越基于CNN和Transformer的扩散策略57%,同时仅需10%的FLOPs和更少活跃参数。我们还进行了全面组件消融分析,为高效可扩展的扩散策略架构设计提供洞见。代码与演示见 https://mbreuss.github.io/MoDE_Diffusion_Policy/。

原文摘要 · Abstract (English)

Diffusion Policies have become widely used in Imitation Learning, offering several appealing properties, such as generating multimodal and discontinuous behavior. As models are becoming larger to capture more complex capabilities, their computational demands increase, as shown by recent scaling laws. Therefore, continuing with the current architectures will present a computational roadblock. To address this gap, we propose Mixture-of-Denoising Experts (MoDE) as a novel policy for Imitation Learning. MoDE surpasses current state-of-the-art Transformer-based Diffusion Policies while enabling parameter-efficient scaling through sparse experts and noise-conditioned routing, reducing both active parameters by 40% and inference costs by 90% via expert caching. Our architecture combines this efficient scaling with noise-conditioned self-attention mechanism, enabling more effective denoising across different noise levels. MoDE achieves state-of-the-art performance on 134 tasks in four established imitation learning benchmarks (CALVIN and LIBERO). Notably, by pretraining MoDE on diverse robotics data, we achieve 4.01 on CALVIN ABC and 0.95 on LIBERO-90. It surpasses both CNN-based and Transformer Diffusion Policies by an average of 57% across 4 benchmarks, while using 90% fewer FLOPs and fewer active parameters compared to default Diffusion Transformer architectures. Furthermore, we conduct comprehensive ablations on MoDE's components, providing insights for designing efficient and scalable Transformer architectures for Diffusion Policies. Code and demonstrations are available at https://mbreuss.github.io/MoDE_Diffusion_Policy/.

扩散模型机器人学习高效推理专家混合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。