arXiv:2409.07163cs.ROcs.CV2024-09中稿 · IROS 2025被引 33

用轻量Mamba模型替代传统扩散策略,参数减少80%仍更高效

Mamba Policy: Towards Efficient 3D Diffusion Policy with Hybrid Selective State Models

  • 混合Mamba与注意力机制,提升特征提取能力
  • 在三个数据集上性能超越基线,计算资源需求显著降低
  • 适合边缘设备部署,长序列任务鲁棒性更强

扩散模型因其高效建模分布的能力,被广泛应用于3D操作任务中,可精确预测动作轨迹。然而,这类模型通常依赖大型参数的UNet作为策略网络,在资源受限设备上部署困难。近期,Mamba模型凭借低计算复杂度和强序列建模能力成为高效建模的新方案。本文提出Mamba Policy,通过引入XMamba Block,将输入信息与条件特征有效融合,并结合Mamba与注意力机制实现深度特征提取,使参数量相比原策略网络减少超过80%,同时实现更优性能。大量实验表明,该方法在Adroit、Dexart和MetaWorld数据集上表现优异,计算资源消耗大幅降低。此外,相较于基线方法,Mamba Policy在长时序场景下展现出更强鲁棒性,并系统评估了不同Mamba变体在框架内的表现。真实世界实验进一步验证了其有效性。开源项目地址:https://sagecao1125.github.io/mamba_policy/

原文摘要 · Abstract (English)

Diffusion models have been widely employed in the field of 3D manipulation due to their efficient capability to learn distributions, allowing for precise prediction of action trajectories. However, diffusion models typically rely on large parameter UNet backbones as policy networks, which can be challenging to deploy on resource-constrained devices. Recently, the Mamba model has emerged as a promising solution for efficient modeling, offering low computational complexity and strong performance in sequence modeling. In this work, we propose the Mamba Policy, a lighter but stronger policy that reduces the parameter count by over 80% compared to the original policy network while achieving superior performance. Specifically, we introduce the XMamba Block, which effectively integrates input information with conditional features and leverages a combination of Mamba and Attention mechanisms for deep feature extraction. Extensive experiments demonstrate that the Mamba Policy excels on the Adroit, Dexart, and MetaWorld datasets, requiring significantly fewer computational resources. Additionally, we highlight the Mamba Policy's enhanced robustness in long-horizon scenarios compared to baseline methods and explore the performance of various Mamba variants within the Mamba Policy framework. Real-world experiments are also conducted to further validate its effectiveness. Our open-source project page can be found at https://sagecao1125.github.io/mamba_policy/.

3D操纵Mamba扩散模型轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。