用不精确的边界框实现3D实例分割,性能媲美全监督方法。
Sketchy Bounding-box Supervision for 3D Instance Segmentation
- 通过扰动真实框生成粗糙边界框,模拟现实中的标注误差。
- 自适应点标签分配使伪标签更紧凑纯净,提升分割精度。
- 适合标注困难但需高精度分割的工业场景应用。
边界框标注在弱监督3D实例分割中受到广泛关注。尽管该方法减少了对密集点级标注的需求,但在实际应用中获取准确边界框仍具挑战。为此,本文研究了不精确的边界框(称作sketchy bounding box),通过添加缩放、平移和旋转扰动生成真实边界框的近似版本。提出Sketchy-3DIS框架,联合学习伪标签生成器与分割器,在粗糙边界框监督下提升性能。首先设计自适应框到点伪标签器,动态将两框重叠区域内的点分配至正确实例,生成紧凑纯净的伪标签;其次提出粗到精的实例分割器,先从点云整体预测粗粒度实例,再基于粗实例区域细化精分割;最后利用伪标签监督分割器,通过联合训练逐步生成高质量实例。大量实验表明,本方法在ScanNetV2和S3DIS基准上达到领先性能,甚至优于部分全监督方法。代码已开源。
原文摘要 · Abstract (English)
Bounding box supervision has gained considerable attention in weakly supervised 3D instance segmentation. While this approach alleviates the need for extensive point-level annotations, obtaining accurate bounding boxes in practical applications remains challenging. To this end, we explore the inaccurate bounding box, named sketchy bounding box, which is imitated through perturbing ground truth bounding box by adding scaling, translation, and rotation. In this paper, we propose Sketchy-3DIS, a novel weakly 3D instance segmentation framework, which jointly learns pseudo labeler and segmentator to improve the performance under the sketchy bounding-box supervisions. Specifically, we first propose an adaptive box-to-point pseudo labeler that adaptively learns to assign points located in the overlapped parts between two sketchy bounding boxes to the correct instance, resulting in compact and pure pseudo instance labels. Then, we present a coarse-to-fine instance segmentator that first predicts coarse instances from the entire point cloud and then learns fine instances based on the region of coarse instances. Finally, by using the pseudo instance labels to supervise the instance segmentator, we can gradually generate high-quality instances through joint training. Extensive experiments show that our method achieves state-of-the-art performance on both the ScanNetV2 and S3DIS benchmarks, and even outperforms several fully supervised methods using sketchy bounding boxes. Code is available at https://github.com/dengq7/Sketchy-3DIS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。