将潜在注意力与Mamba结合,高效建模点云几何结构。
PointLAMA: Latent Attention meets Mamba for Efficient Point Cloud Pretraining
- 用空间填充曲线和轴向排序对点云编码,适配分类与分割任务。
- 轻量级潜在注意力块在保持效率的同时增强局部结构建模能力。
- 适合追求高效点云预训练的科研与工业应用者。
Mamba作为点云建模的骨干模型,凭借状态空间架构实现了线性复杂度的全局序列建模,但其缺乏局部归纳偏置,难以捕捉3D数据中的细粒度几何结构。为此,我们提出PointLAMA,一个结合任务感知点云序列化、融合潜在注意力与Mamba模块的混合编码器,以及基于Mamba骨干的条件扩散机制的点云预训练框架。具体而言,任务感知序列化采用希尔伯特/转置希尔伯特空间填充曲线与轴向排序,分别对分类与分割任务进行结构对齐。轻量级潜在注意力块包含点式多头潜在注意力(PMLA)模块,其共享潜在空间特性与Mamba一致,实现局部上下文增强且不牺牲整体效率。为进一步提升表征学习能力,预训练阶段引入条件扩散机制,通过去噪扰动特征序列实现隐式学习,无需显式点级重建。实验表明,PointLAMA在多个基准数据集上达到具有竞争力的性能,同时参数量与浮点运算量极低,验证了其在高效点云预训练中的有效性。
原文摘要 · Abstract (English)
Mamba has recently gained widespread attention as a backbone model for point cloud modeling, leveraging a state-space architecture that enables efficient global sequence modeling with linear complexity. However, its lack of local inductive bias limits its capacity to capture fine-grained geometric structures in 3D data. To address this limitation, we propose \textbf{PointLAMA}, a point cloud pretraining framework that combines task-aware point cloud serialization, a hybrid encoder with integrated Latent Attention and Mamba blocks, and a conditional diffusion mechanism built upon the Mamba backbone. Specifically, the task-aware point cloud serialization employs Hilbert/Trans-Hilbert space-filling curves and axis-wise sorting to structurally align point tokens for classification and segmentation tasks, respectively. Our lightweight Latent Attention block features a Point-wise Multi-head Latent Attention (PMLA) module, which is specifically designed to align with the Mamba architecture by leveraging the shared latent space characteristics of PMLA and Mamba. This enables enhanced local context modeling while preserving overall efficiency. To further enhance representation learning, we incorporate a conditional diffusion mechanism during pretraining, which denoises perturbed feature sequences without relying on explicit point-wise reconstruction. Experimental results demonstrate that PointLAMA achieves competitive performance on multiple benchmark datasets with minimal parameter count and FLOPs, validating its effectiveness for efficient point cloud pretraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。