arXiv:2505.20941cs.CV2025-05CVPR被引 11

通过Mamba融合多层特征,提升点云理解能力

PMA: Towards Parameter-Efficient Point Cloud Understanding via Point Mamba Adapter

  • 用Mamba构建有序特征序列,整合预训练模型中间层信息
  • 在多个数据集上显著提升点云理解性能,超越现有方法
  • 适合需要高效利用预训练模型的3D视觉研究者

将预训练模型应用于点云理解已成为3D感知的主流范式。然而,现有方法仅使用预训练模型的最终输出,忽略了中间层丰富的互补信息,未能充分挖掘预训练模型潜力。为此,我们提出正交解决方案:点云Mamba适配器(PMA),从预训练模型所有层构建有序特征序列,并利用Mamba融合多层语义,实现更全面的点云理解。由于三维空间固有的各向同性,构建该序列具有挑战性。因此,我们进一步提出跨层共享的几何约束门提示生成器(G2PG),通过共享几何约束动态优化Mamba输出门的空间顺序,实现多层信息的有效整合。在多个挑战性点云数据集上的广泛实验表明,PMA通过融合多样化互补中间特征,显著提升了点云理解能力。代码已公开于https://github.com/zyh16143998882/PMA。

原文摘要 · Abstract (English)

Applying pre-trained models to assist point cloud understanding has recently become a mainstream paradigm in 3D perception. However, existing application strategies are straightforward, utilizing only the final output of the pre-trained model for various task heads. It neglects the rich complementary information in the intermediate layer, thereby failing to fully unlock the potential of pre-trained models. To overcome this limitation, we propose an orthogonal solution: Point Mamba Adapter (PMA), which constructs an ordered feature sequence from all layers of the pre-trained model and leverages Mamba to fuse all complementary semantics, thereby promoting comprehensive point cloud understanding. Constructing this ordered sequence is non-trivial due to the inherent isotropy of 3D space. Therefore, we further propose a geometry-constrained gate prompt generator (G2PG) shared across different layers, which applies shared geometric constraints to the output gates of the Mamba and dynamically optimizes the spatial order, thus enabling more effective integration of multi-layer information. Extensive experiments conducted on challenging point cloud datasets across various tasks demonstrate that our PMA elevates the capability for point cloud understanding to a new level by fusing diverse complementary intermediate features. Code is available at https://github.com/zyh16143998882/PMA.

点云理解Mamba特征融合参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。