arXiv:2510.12182cs.CV2025-10被引 1

用框标注训练3D实例分割模型,无需密集标注

BEEP3D: Box-Supervised End-to-End Pseudo-Mask Generation for 3D Instance Segmentation

  • 师生框架自动生成伪掩码,端到端优化
  • 在ScanNetV2和S3DIS上达到顶尖性能
  • 适合标注成本高的3D场景理解任务

3D实例分割对理解复杂3D环境至关重要,但全监督方法需密集点级标注,导致高昂标注成本。为降低负担,研究采用更易获取的框级标注作为弱监督信号。然而框标注在重叠区域存在歧义,难以准确分配点到实例。现有方法通过额外训练阶段生成伪掩码,但多阶段流程增加训练时间与复杂度,阻碍端到端优化。为此,本文提出BEEP3D——基于框标注的端到端伪掩码生成方法。BEEP3D采用师生框架,教师模型作为伪标签生成器,通过指数移动平均由学生模型更新。为提升教师生成伪掩码的精度,引入基于实例中心的查询精化机制,增强位置查询定位能力,并利用实例中心附近特征。同时设计两种新损失:查询一致性损失与掩码特征一致性损失,对齐预测与伪掩码间的语义与几何信号。在ScanNetV2和S3DIS数据集上的大量实验表明,BEEP3D性能优于或媲美当前最优弱监督方法,且计算效率高。

原文摘要 · Abstract (English)

3D instance segmentation is crucial for understanding complex 3D environments, yet fully supervised methods require dense point-level annotations, resulting in substantial annotation costs and labor overhead. To mitigate this, box-level annotations have been explored as a weaker but more scalable form of supervision. However, box annotations inherently introduce ambiguity in overlapping regions, making accurate point-to-instance assignment challenging. Recent methods address this ambiguity by generating pseudo-masks through training a dedicated pseudo-labeler in an additional training stage. However, such two-stage pipelines often increase overall training time and complexity, hinder end-to-end optimization. To overcome these challenges, we propose BEEP3D-Box-supervised End-to-End Pseudo-mask generation for 3D instance segmentation. BEEP3D adopts a student-teacher framework, where the teacher model serves as a pseudo-labeler and is updated by the student model via an Exponential Moving Average. To better guide the teacher model to generate precise pseudo-masks, we introduce an instance center-based query refinement that enhances position query localization and leverages features near instance centers. Additionally, we design two novel losses-query consistency loss and masked feature consistency loss-to align semantic and geometric signals between predictions and pseudo-masks. Extensive experiments on ScanNetV2 and S3DIS datasets demonstrate that BEEP3D achieves competitive or superior performance compared to state-of-the-art weakly supervised methods while remaining computationally efficient.

3D分割弱监督伪标签端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。