用几何约束提升3D弱监督语义分割的伪标签质量
3D Weakly Supervised Semantic Segmentation via Class-Aware and Geometry-Guided Pseudo-Label Refinement
- 分两步优化伪标签:先按类别平衡,再用几何合理性过滤
- 在ScanNet和S3DIS上达最新最好性能,泛化能力强
- 适合做3D场景理解且缺乏密集标注的研究者
3D弱监督语义分割旨在利用稀疏或低成本标注数据实现语义分割,大幅减少对密集点级标注的依赖。现有方法主要依赖类别激活图或预训练视觉-语言模型,但伪标签质量低与3D几何先验利用不足共同构成技术瓶颈。本文提出一种简单有效的方法,将3D几何先验融入类别感知引导机制,生成高保真伪标签。首先通过类别感知伪标签精炼模块,实现类别特异性优化以提升标签准确性;随后引入几何感知伪标签精炼组件,利用隐含3D几何约束过滤不符合几何合理性的低置信度伪标签。针对大量未标注区域,设计了结合自训练的标签更新策略,实现标签迭代传播与覆盖扩展。实验证明,该方法在ScanNet和S3DIS基准上均达到当前最优性能,并在无监督设置下展现良好泛化能力,保持了优异准确率。
原文摘要 · Abstract (English)
3D weakly supervised semantic segmentation (3D WSSS) aims to achieve semantic segmentation by leveraging sparse or low-cost annotated data, significantly reducing reliance on dense point-wise annotations. Previous works mainly employ class activation maps or pre-trained vision-language models to address this challenge. However, the low quality of pseudo-labels and the insufficient exploitation of 3D geometric priors jointly create significant technical bottlenecks in developing high-performance 3D WSSS models. In this paper, we propose a simple yet effective 3D weakly supervised semantic segmentation method that integrates 3D geometric priors into a class-aware guidance mechanism to generate high-fidelity pseudo labels. Concretely, our designed methodology first employs Class-Aware Label Refinement module to generate more balanced and accurate pseudo labels for semantic categrories. This initial refinement stage focuses on enhancing label quality through category-specific optimization. Subsequently, the Geometry-Aware Label Refinement component is developed, which strategically integrates implicit 3D geometric constraints to effectively filter out low-confidence pseudo labels that fail to comply with geometric plausibility. Moreover, to address the challenge of extensive unlabeled regions, we propose a Label Update strategy that integrates Self-Training to propagate labels into these areas. This iterative process continuously enhances pseudo-label quality while expanding label coverage, ultimately fostering the development of high-performance 3D WSSS models. Comprehensive experimental validation reveals that our proposed methodology achieves state-of-the-art performance on both ScanNet and S3DIS benchmarks while demonstrating remarkable generalization capability in unsupervised settings, maintaining competitive accuracy through its robust design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。