arXiv:2504.02454cs.CV2025-04AAAI被引 36

不用预训练,用泰勒展开思想拟合点云局部结构,提升少样本分割精度。

Taylor Series-Inspired Local Structure Fitting Network for Few-shot Point Cloud Semantic Segmentation

  • 将点云局部结构建模为多项式拟合问题,设计新型卷积算子TaylorConv。
  • 在S3DIS和ScanNet上2类1样本设置下,mIoU分别提升2.28%和4.37%。
  • 无需预训练,适合资源受限或新类别快速部署的场景。

少样本点云语义分割旨在仅用少量标注数据准确分割点云场景中的“未见”新类别。然而,现有基于预训练的方法不仅引入大量时间开销,还忽视了不规则点云的局部结构表示。为此,我们提出一种无预训练的局部结构拟合网络TaylorSeg。受泰勒级数启发,将点云局部结构表示视为多项式拟合问题,设计新型局部结构拟合卷积TaylorConv,显式编码局部几何结构,学习点云的低阶基础信息与高阶精细化信息。基于TaylorConv,构建两种变体:非参数化TaylorSeg-NN与参数化TaylorSeg-PN。前者在无预训练条件下达到与现有参数模型相当的性能;后者引入自适应推拉(APP)模块,缓解查询集与支持集间的特征分布差异。大量实验验证方法有效性。在2类1样本设置下,TaylorSeg-PN在S3DIS和ScanNet数据集上的mIoU分别较之前最优方法提升+2.28%和+4.37%。代码已开源。

原文摘要 · Abstract (English)

Few-shot point cloud semantic segmentation aims to accurately segment "unseen" new categories in point cloud scenes using limited labeled data. However, pretraining-based methods not only introduce excessive time overhead but also overlook the local structure representation among irregular point clouds. To address these issues, we propose a pretraining-free local structure fitting network for few-shot point cloud semantic segmentation, named TaylorSeg. Specifically, inspired by Taylor series, we treat the local structure representation of irregular point clouds as a polynomial fitting problem and propose a novel local structure fitting convolution, called TaylorConv. This convolution learns the low-order basic information and high-order refined information of point clouds from explicit encoding of local geometric structures. Then, using TaylorConv as the basic component, we construct two variants of TaylorSeg: a non-parametric TaylorSeg-NN and a parametric TaylorSeg-PN. The former can achieve performance comparable to existing parametric models without pretraining. For the latter, we equip it with an Adaptive Push-Pull (APP) module to mitigate the feature distribution differences between the query set and the support set. Extensive experiments validate the effectiveness of the proposed method. Notably, under the 2-way 1-shot setting, TaylorSeg-PN achieves improvements of +2.28% and +4.37% mIoU on the S3DIS and ScanNet datasets respectively, compared to the previous state-of-the-art methods. Our code is available at https://github.com/changshuowang/TaylorSeg.

点云分割少样本学习几何结构无预训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。