arXiv:2409.08102cs.CV2024-09ECCV被引 2

用贝叶斯方法自训练,仅靠少量标注数据实现3D分割新纪录

Bayesian Self-Training for Semi-Supervised 3D Segmentation

  • 通过随机推理生成伪标签,再按点级不确定性过滤
  • 在SemanticKITTI等数据集上达当前最优性能,提升显著
  • 适用于语义分割、实例分割和视觉定位,适合标注稀缺场景

3D分割是计算机视觉核心问题,但全监督训练需大量标注数据,而密集标注3D点云成本高昂。半监督学习仅需少量标注数据与大量未标注数据,成为更实用的替代方案。受贝叶斯深度学习启发,本文提出一种贝叶斯自训练框架,利用随机推断生成初始伪标签,并基于点级不确定性进行筛选。通过构建n-部匹配启发式算法,该方法扩展至半监督3D实例分割,并进一步应用于密集3D视觉定位。在SemanticKITTI和ScribbleKITTI上,3D语义分割达到当前最优;在ScanNet和S3DIS上,3D实例分割表现领先;在ScanRefer上,密集3D视觉定位相比纯监督基线有显著提升。

原文摘要 · Abstract (English)

3D segmentation is a core problem in computer vision and, similarly to many other dense prediction tasks, it requires large amounts of annotated data for adequate training. However, densely labeling 3D point clouds to employ fully-supervised training remains too labor intensive and expensive. Semi-supervised training provides a more practical alternative, where only a small set of labeled data is given, accompanied by a larger unlabeled set. This area thus studies the effective use of unlabeled data to reduce the performance gap that arises due to the lack of annotations. In this work, inspired by Bayesian deep learning, we first propose a Bayesian self-training framework for semi-supervised 3D semantic segmentation. Employing stochastic inference, we generate an initial set of pseudo-labels and then filter these based on estimated point-wise uncertainty. By constructing a heuristic $n$-partite matching algorithm, we extend the method to semi-supervised 3D instance segmentation, and finally, with the same building blocks, to dense 3D visual grounding. We demonstrate state-of-the-art results for our semi-supervised method on SemanticKITTI and ScribbleKITTI for 3D semantic segmentation and on ScanNet and S3DIS for 3D instance segmentation. We further achieve substantial improvements in dense 3D visual grounding over supervised-only baselines on ScanRefer. Our project page is available at ouenal.github.io/bst/.

3D分割半监督贝叶斯自训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。