用扩散模型扩展点云少样本分割的原型,提升泛化能力。
Few to Big: Prototype Expansion Network via Diffusion Learner for Point Cloud Few-shot Semantic Segmentation

- 用扩散模型生成丰富特征,扩充原型表征能力
- 通过推拉机制对齐原型与查询空间,减少偏差
- 适合点云少样本分割研究者和工业场景应用
少样本3D点云语义分割旨在仅用少量标注支持样本分割新类别。然而,由有限非结构化支持集生成的原型常存在对齐不准、容量不足问题,限制了对新类别的泛化性能。根源在于:1)原型表征能力有限,无法覆盖类别内部多样性;2)因支持集与查询集间不一致,导致原型与查询空间错位。为此,本文提出原型扩展网络(PENet),利用扩散模型预训练条件编码器生成丰富特征以扩展原型,并引入推拉力对齐机制将其映射至查询空间。PENet采用双流学习架构:保留传统全监督内在学习器(IL)提取代表性特征,新增扩散学习器(DL)提供可迁移特征。双源原型经原型融合模块(PAM)处理,采用推拉注意力机制对齐查询空间。此外,原型校准机制(PCM)防止语义漂移。在S3DIS和ScanNet数据集上的实验表明,PENet在多种少样本设置下优于现有方法。
原文摘要 · Abstract (English)
Few-shot 3D point cloud semantic segmentation aims to segment novel categories using a minimal number of annotated support samples. However, prototypes derived from the limited non-structural point cloud support set are often misaligned and have a small capacity, hindering effective gen eralization to novel categories. This stems from two core issues: i) the prototype possess limited representational capacity fails to cover the full intra-class diversity of a novel category, and ii) the prototypes suffer from misalignment with the query space due to the inter-set inconsistency between support and query sets. To address these issues, our work focuses on leveraging the few support samples to construct a well-aligned big-capacity prototype. Motivated by the powerful generative capabilities of diffusion models, we re-purpose its pre-trained conditional encoder to provide rich feature components for prototype ex pansion. Subsequently, a push-pull force aligns this expanded prototype towards the query feature space. Under this setup, we introduce the Prototype Expansion Network (PENet), a framework that constructs aligned big-capacity prototypes from two complementary feature sources. Specifically, PENet employs a dual-stream learner architecture: it retains a conventional fully supervised Intrinsic Learner (IL) to distill representative features, while introducing a novel Diffusion Learner (DL) to provide rich generalizable features. The resulting dual prototypes are then processed by a Prototype Assimilation Module (PAM), which adopts a push-pull attention block to align the prototypes with the query space. Furthermore, a Prototype Calibration Mechanism (PCM) regularizes the final big-capacity prototype to prevent semantic drift. Extensive experiments on the S3DIS and ScanNet datasets demonstrate that PENet outperforms state-of-the-art methods across various few-shot settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。