用锯齿扫描增强点云空间连续性,提升自监督学习效果
ZigzagPointMamba: Spatial-Semantic Mamba for Point Cloud Understanding
- 采用锯齿扫描路径全局排序点云,保持邻近点的空间连续性
- 提出语义孪生掩码策略,通过相似点对重建提升局部语义建模
- 在多个点云任务上显著优于现有方法,适合点云理解研究者
基于状态空间模型(SSM)的PointMamba能以线性复杂度高效提取点云特征,在自监督学习中计算效率超越Transformer。但现有方法依赖复杂的标记排序和随机掩码,破坏了空间连续性和局部语义关联。为此,我们提出ZigzagPointMamba,核心是简单的锯齿扫描路径,全局序列化点云标记,强化空间邻近点的连续性。然而,随机掩码会削弱自监督学习中的局部语义建模。为此,我们引入语义孪生掩码策略(SMS),掩码语义相似的点,通过融合原始点与相似点的局部特征实现重建,克服对孤立局部特征的依赖,实现稳健的全局语义建模。预训练的ZigzagPointMamba在下游任务中表现优异:在ShapeNetPart上部分分割的mIoU提升1.59%,ModelNet40分类准确率提高0.4%,在ScanObjectNN的OBJ-BG、OBJ-ONLY和PB-T50-RS子集上分类准确率分别提升0.19%、1.22%和0.72%。
原文摘要 · Abstract (English)
State Space models (SSMs) such as PointMamba enable efficient feature extraction for point cloud self-supervised learning with linear complexity, outperforming Transformers in computational efficiency. However, existing PointMamba-based methods depend on complex token ordering and random masking, which disrupt spatial continuity and local semantic correlations. We propose ZigzagPointMamba to tackle these challenges. The core of our approach is a simple zigzag scan path that globally sequences point cloud tokens, enhancing spatial continuity by preserving the proximity of spatially adjacent point tokens. Nevertheless, random masking undermines local semantic modeling in self-supervised learning. To address this, we introduce a Semantic-Siamese Masking Strategy (SMS), which masks semantically similar tokens to facilitate reconstruction by integrating local features of original and similar tokens. This overcomes the dependence on isolated local features and enables robust global semantic modeling. Our pre-trained ZigzagPointMamba weights significantly improve downstream tasks, achieving a 1.59% mIoU gain on ShapeNetPart for part segmentation, a 0.4% higher accuracy on ModelNet40 for classification, and 0.19%, 1.22%, and 0.72% higher accuracies respectively for the classification tasks on the OBJ-BG, OBJ-ONLY, and PB-T50-RS subsets of ScanObjectNN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。