解决3D点云分割中未见类别误判问题,提升模型泛化能力。
Generalized Zero-Shot Learning for Point Cloud Segmentation with Evidence-Based Dynamic Calibration

- 引入基于证据的不确定性估计,动态校准预测概率。
- 在ScanNet v2和S3DIS上达到当前最优性能。
- 适合需要处理未见过类别的3D场景理解任务。
3D点云的广义零样本语义分割旨在将每个点分类为已见和未见类别。这类模型常因训练中接触过某些类别而产生偏差预测,尤其在3D应用中更严重,因训练数据规模通常小于图像任务。为此,本文提出E3DPC-GZSL方法,通过将基于证据的不确定性估计器融入分类器,减少对已见类别的过度自信预测,无需为已见与未见类别分别设置分类器。该估计器用于生成动态校准堆叠因子,根据点级预测不确定性调整输出概率。此外,提出一种新训练策略,通过融合可学习参数与文本导出特征,优化语义空间,提升对未见数据的建模能力。大量实验表明,该方法在ScanNet v2和S3DIS等广义零样本分割数据集上达到当前最优性能。
原文摘要 · Abstract (English)
Generalized zero-shot semantic segmentation of 3D point clouds aims to classify each point into both seen and unseen classes. A significant challenge with these models is their tendency to make biased predictions, often favoring the classes encountered during training. This problem is more pronounced in 3D applications, where the scale of the training data is typically smaller than in image-based tasks. To address this problem, we propose a novel method called E3DPC-GZSL, which reduces overconfident predictions towards seen classes without relying on separate classifiers for seen and unseen data. E3DPC-GZSL tackles the overconfidence problem by integrating an evidence-based uncertainty estimator into a classifier. This estimator is then used to adjust prediction probabilities using a dynamic calibrated stacking factor that accounts for pointwise prediction uncertainty. In addition, E3DPC-GZSL introduces a novel training strategy that improves uncertainty estimation by refining the semantic space. This is achieved by merging learnable parameters with text-derived features, thereby improving model optimization for unseen data. Extensive experiments demonstrate that the proposed approach achieves state-of-the-art performance on generalized zero-shot semantic segmentation datasets, including ScanNet v2 and S3DIS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。