让3D点云分割的原型更懂查询数据,提升少样本泛化能力。
Query-aware Hub Prototype Learning for Few-Shot 3D Point Cloud Semantic Segmentation
- 构建支持与查询点的双向图,找共现枢纽生成相关原型
- 在S3DIS和ScanNet上显著超越现有方法,精度提升超5%
- 适合做少样本3D语义分割的研究者和工程师参考
少样本3D点云语义分割(FS-3DSeg)旨在仅用少量标注样本对新类别进行分割。然而,现有基于度量的原型学习方法仅从支持集生成原型,未考虑其与查询数据的相关性,导致原型偏向支持集特征,在分布偏移下难以泛化,性能下降。为此,我们提出查询感知枢纽原型(QHP)学习方法,显式建模支持集与查询集间的语义关联。具体地,设计枢纽原型生成(HPG)模块,通过构建连接查询与支持点的二部图,识别高频关联的支持枢纽,生成与查询相关的原型以更好捕捉跨集语义。为进一步抑制劣质枢纽及边界模糊原型的影响,引入原型分布优化(PDO)模块,采用纯度加权对比损失,将劣质枢纽和离群原型拉近至对应类别中心,优化原型表示。在S3DIS和ScanNet上的大量实验表明,QHP显著优于当前最优方法,有效缩小了原型与查询集间的语义差距。
原文摘要 · Abstract (English)
Few-shot 3D point cloud semantic segmentation (FS-3DSeg) aims to segment novel classes with only a few labeled samples. However, existing metric-based prototype learning methods generate prototypes solely from the support set, without considering their relevance to query data. This often results in prototype bias, where prototypes overfit support-specific characteristics and fail to generalize to the query distribution, especially in the presence of distribution shifts, which leads to degraded segmentation performance. To address this issue, we propose a novel Query-aware Hub Prototype (QHP) learning method that explicitly models semantic correlations between support and query sets. Specifically, we propose a Hub Prototype Generation (HPG) module that constructs a bipartite graph connecting query and support points, identifies frequently linked support hubs, and generates query-relevant prototypes that better capture cross-set semantics. To further mitigate the influence of bad hubs and ambiguous prototypes near class boundaries, we introduce a Prototype Distribution Optimization (PDO) module, which employs a purity-reweighted contrastive loss to refine prototype representations by pulling bad hubs and outlier prototypes closer to their corresponding class centers. Extensive experiments on S3DIS and ScanNet demonstrate that QHP achieves substantial performance gains over state-of-the-art methods, effectively narrowing the semantic gap between prototypes and query sets in FS-3DSeg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。