arXiv:2409.17547cs.CVcs.AI2024-09被引 2

提出三重掩码机制,提升3D点云自编码器在小样本下的预训练效果。

Triple Point Masking

  • 设计中等和低掩码策略,支持多粒度重建。
  • 在多个下游任务上实现显著性能提升,线性精度更高。
  • 适合需要精细3D重建的工业或机器人场景应用。

现有3D掩码学习方法在数据有限时表现受限。本文提出一种名为TPM的三重点掩码方案,作为可扩展的掩码自编码器预训练框架,实现对3D点云的多掩码学习。核心思路是:物体恢复过程具有多样性。传统高掩码方法仅关注全局表征,缺乏细粒度重建能力,导致微调时性能受限。TPM引入中等与低掩码策略,使预训练自编码器能兼顾多种对象表示,增强重建灵活性与准确性。此外,提出基于SVM的权重选择模块,在微调阶段选取最优参数,最大化线性分类准确率,助力新对象复杂表征的学习。大量实验表明,四个基线模型结合TPM后,在多个下游任务中均取得全面改进。代码与模型已公开于https://github.com/liujia99/TPM。

原文摘要 · Abstract (English)

Existing 3D mask learning methods encounter performance bottlenecks under limited data, and our objective is to overcome this limitation. In this paper, we introduce a triple point masking scheme, named TPM, which serves as a scalable framework for pre-training of masked autoencoders to achieve multi-mask learning for 3D point clouds. Specifically, we augment the baselines with two additional mask choices (i.e., medium mask and low mask) as our core insight is that the recovery process of an object can manifest in diverse ways. Previous high-masking schemes focus on capturing the global representation but lack the fine-grained recovery capability, so that the generated pre-trained weights tend to play a limited role in the fine-tuning process. With the support of the proposed TPM, available methods can exhibit more flexible and accurate completion capabilities, enabling the potential autoencoder in the pre-training stage to consider multiple representations of a single 3D object. In addition, an SVM-guided weight selection module is proposed to fill the encoder parameters for downstream networks with the optimal weight during the fine-tuning stage, maximizing linear accuracy and facilitating the acquisition of intricate representations for new objects. Extensive experiments show that the four baselines equipped with the proposed TPM achieve comprehensive performance improvements on various downstream tasks. Our code and models are available at https://github.com/liujia99/TPM.

3D重建掩码学习自编码器点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。