仅用一次点击标注,实现自动驾驶3D实例分割的低成本高精度训练
You Only Click Once: Single Point Weakly Supervised 3D Instance Segmentation for Autonomous Driving
- 基于鸟瞰图单点点击生成伪标签,结合视觉大模型与几何约束提升质量
- 利用时序邻帧与点云密度变化动态更新标签,显著减少误标
- 通过IoU引导优化,0.8%标注数据即可媲美全监督方法性能
室外激光雷达点云的3D实例分割在自动驾驶中至关重要,但标注成本高昂。为此,我们提出YoCo框架,仅需鸟瞰图中的少量粗略点击标注,即可生成高质量3D伪标签。该框架首先融合视觉基础模型与点云几何约束,增强伪标签生成;其次设计时空联合标签更新模块,利用相邻帧预测和点云固有的密度分布特征(近处密、远处疏)进行可靠更新;最后引入IoU引导增强模块,以高置信度且高交并比的预测替换伪标签。在Waymo数据集上的实验表明,YoCo在弱监督方法中达到领先水平,超越全监督的Cylinder3D。该方法适用于多种网络架构,在仅使用0.8%全标注数据的情况下,经极少微调即达到接近全监督的效果,大幅降低标注成本。
原文摘要 · Abstract (English)
Outdoor LiDAR point cloud 3D instance segmentation is a crucial task in autonomous driving. However, it requires laborious human efforts to annotate the point cloud for training a segmentation model. To address this challenge, we propose a YoCo framework, which generates 3D pseudo labels using minimal coarse click annotations in the bird's eye view plane. It is a significant challenge to produce high-quality pseudo labels from sparse annotations. Our YoCo framework first leverages vision foundation models combined with geometric constraints from point clouds to enhance pseudo label generation. Second, a temporal and spatial-based label updating module is designed to generate reliable updated labels. It leverages predictions from adjacent frames and utilizes the inherent density variation of point clouds (dense near, sparse far). Finally, to further improve label quality, an IoU-guided enhancement module is proposed, replacing pseudo labels with high-confidence and high-IoU predictions. Experiments on the Waymo dataset demonstrate YoCo's effectiveness and generality, achieving state-of-the-art performance among weakly supervised methods and surpassing fully supervised Cylinder3D. Additionally, the YoCo is suitable for various networks, achieving performance comparable to fully supervised methods with minimal fine-tuning using only 0.8% of the fully labeled data, significantly reducing annotation costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。