让3D点云分割模型学会估计不确定性,提升少样本下的分割精度与可靠性。
Uncertainty-aware Prototype Learning with Variational Inference for Few-shot Point Cloud Segmentation

- 用双流结构融合支持集和查询集信息,动态优化原型表示。
- 将原型建模为潜在变量,通过变分推断显式捕捉预测不确定性。
- 在ScanNet和S3DIS上表现领先,适合对可靠性要求高的场景应用。
少样本3D语义分割旨在仅用少量标注的支持样本生成查询点云的精确语义掩码。现有基于原型的方法通常从支持集构建紧凑且确定性的原型以指导分割,但这类刚性表示无法捕捉稀缺监督带来的内在不确定性,导致鲁棒性下降、泛化能力受限。本文提出UPL(不确定性感知原型学习),一种将不确定性建模融入少样本3D分割原型学习的概率方法。框架引入两个关键组件:首先,设计双流原型精炼模块,联合利用支持集与查询集的有限信息增强原型表征;其次,将原型学习建模为变分推断问题,将类别原型视为潜在变量,实现显式的不确定性建模,从而提供更稳健、可解释的掩码预测。在广泛使用的ScanNet和S3DIS基准上的大量实验表明,UPL在不同设置下均取得一致的最先进性能,并能提供可靠的不确定性估计。代码已公开于https://fdueblab-upl.github.io/。
原文摘要 · Abstract (English)
Few-shot 3D semantic segmentation aims to generate accurate semantic masks for query point clouds with only a few annotated support examples. Existing prototype-based methods typically construct compact and deterministic prototypes from the support set to guide query segmentation. However, such rigid representations are unable to capture the intrinsic uncertainty introduced by scarce supervision, which often results in degraded robustness and limited generalization. In this work, we propose UPL (Uncertainty-aware Prototype Learning), a probabilistic approach designed to incorporate uncertainty modeling into prototype learning for few-shot 3D segmentation. Our framework introduces two key components. First, UPL introduces a dual-stream prototype refinement module that enriches prototype representations by jointly leveraging limited information from both support and query samples. Second, we formulate prototype learning as a variational inference problem, regarding class prototypes as latent variables. This probabilistic formulation enables explicit uncertainty modeling, providing robust and interpretable mask predictions. Extensive experiments on the widely used ScanNet and S3DIS benchmarks show that our UPL achieves consistent state-of-the-art performance under different settings while providing reliable uncertainty estimation. The code is available at https://fdueblab-upl.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。