用场景级标注实现高效3D实例分割,无需密集标注。
DBGroup: Dual-Branch Point Grouping for Weakly Supervised 3D Semantic Instance Segmentation

- 双分支点分组生成伪标签,结合图像语义与掩码线索。
- 多轮自训练提升分割精度,伪标签准确率超90%。
- 适合大规模点云数据,降低人工标注成本。
弱监督3D实例分割对场景理解至关重要,尤其在数据规模扩大和全监督标注成本高昂的背景下。现有方法主要依赖点击标注或边界框,仍存在标注繁琐、复杂度高、依赖专家等问题。为此,我们提出DBGroup,一种两阶段弱监督3D实例分割框架,采用更高效可扩展的场景级标注。第一阶段引入双分支点分组模块,利用多视图图像提取的语义与掩码线索生成伪标签;进一步设计粒度感知实例合并与语义选择传播策略提升标签质量。第二阶段通过多轮自训练,在端到端实例分割网络上优化模型。此外,提出实例掩码过滤策略解决伪标签不一致性。大量实验表明,DBGroup在稀疏点级监督方法中表现相当,且优于当前最先进的场景级监督方法。代码已公开于https://github.com/liuxuexun/DBGroup。
原文摘要 · Abstract (English)
Weakly supervised 3D instance segmentation is essential for 3D scene understanding, especially as the growing scale of data and high annotation costs associated with fully supervised approaches. Existing methods primarily rely on two forms of weak supervision: one-thing-one-click annotations and bounding box annotations, both of which aim to reduce labeling efforts. However, these approaches still encounter limitations, including labor-intensive annotation processes, high complexity, and reliance on expert annotators. To address these challenges, we propose \textbf{DBGroup}, a two-stage weakly supervised 3D instance segmentation framework that leverages scene-level annotations as a more efficient and scalable alternative. In the first stage, we introduce a Dual-Branch Point Grouping module to generate pseudo labels guided by semantic and mask cues extracted from multi-view images. To further improve label quality, we develop two refinement strategies: Granularity-Aware Instance Merging and Semantic Selection and Propagation. The second stage involves multi-round self-training on an end-to-end instance segmentation network using the refined pseudo-labels. Additionally, we introduce an Instance Mask Filter strategy to address inconsistencies within the pseudo labels. Extensive experiments demonstrate that DBGroup achieves competitive performance compared to sparse-point-level supervised 3D instance segmentation methods, while surpassing state-of-the-art scene-level supervised 3D semantic segmentation approaches. Code is available at https://github.com/liuxuexun/DBGroup.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。