arXiv:2601.22018cs.RO2026-01被引 2

轻量化3D视觉运动策略,参数少于1%仍保持顶尖性能

PocketDP3: Efficient Pocket-Scale 3D Visuomotor Policy

  • 用MLP-Mixer构建轻量扩散混合器替代大模型解码器
  • 参数不足前人1%,推理速度更快且支持两步推断
  • 适合资源受限的机器人实时部署,实测效果优异

近期基于3D视觉的扩散策略在学习复杂机器人操作技能方面表现强劲。然而,这些模型普遍存在架构失配问题:小型高效点云编码器常搭配庞大解码器,导致大量参数浪费。针对此问题,我们提出PocketDP3——一种口袋级3D扩散策略,将先前方法中庞大的条件U-Net解码器替换为基于MLP-Mixer块的轻量级扩散混合器(DiM),实现时序与通道维度的高效融合,显著降低模型规模。值得注意的是,无需额外一致性蒸馏技术,本方法即可支持两步推理而不损失性能,提升实际部署效率。在RoboTwin2.0、Adroit和MetaWorld三个仿真基准上,PocketDP3以不到1%的参数量达到当前最优性能,并大幅加速推理。真实世界实验进一步验证了其实际应用价值与跨域迁移能力。代码将公开。

原文摘要 · Abstract (English)

Recently, 3D vision-based diffusion policies have shown strong capability in learning complex robotic manipulation skills. However, a common architectural mismatch exists in these models: a tiny yet efficient point-cloud encoder is often paired with a massive decoder. Given a compact scene representation, we argue that this may lead to substantial parameter waste in the decoder. Motivated by this observation, we propose PocketDP3, a pocket-scale 3D diffusion policy that replaces the heavy conditional U-Net decoder used in prior methods with a lightweight Diffusion Mixer (DiM) built on MLP-Mixer blocks. This architecture enables efficient fusion across temporal and channel dimensions, significantly reducing model size. Notably, without any additional consistency distillation techniques, our method supports two-step inference without sacrificing performance, improving practicality for real-time deployment. Across three simulation benchmarks--RoboTwin2.0, Adroit, and MetaWorld--PocketDP3 achieves state-of-the-art performance with fewer than 1% of the parameters of prior methods, while also accelerating inference. Real-world experiments further demonstrate the practicality and transferability of our method in real-world settings. Code will be released.

机器人扩散模型轻量化3D视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。