用自动标注的CAD数据训练3D模型,效果更好且成本更低。
Leveraging Automatic CAD Annotations for Supervised Learning in 3D Scene Understanding
- 通过自动检索合成CAD模型生成3D场景标注
- 模型在点云补全和单视图建模任务上超越人工标注数据
- 适合做3D理解、降低标注成本的研究者使用
高阶3D场景理解在诸多应用中至关重要,但准确的3D标注难以获取,制约了深度学习模型的发展。本文利用近期在自动检索合成CAD模型方面的进展,证明此类数据可作为高质量监督信号用于训练深度学习模型。具体而言,我们采用类似先前用于为ScanNet场景自动标注9自由度姿态与CAD模型的流程,将其应用于此前缺乏标注的ScanNet++ v1数据集。实验表明,基于这些自动生成的标注训练的模型不仅可行,且在点云补全与单视图CAD模型检索与对齐两项任务上优于基于人工标注训练的模型。结果表明,自动3D标注能显著提升模型性能并大幅降低标注成本。为推动未来研究,我们将公开所生成的标注(命名为SCANnotate++)及训练模型。
原文摘要 · Abstract (English)
High-level 3D scene understanding is essential in many applications. However, the challenges of generating accurate 3D annotations make development of deep learning models difficult. We turn to recent advancements in automatic retrieval of synthetic CAD models, and show that data generated by such methods can be used as high-quality ground truth for training supervised deep learning models. More exactly, we employ a pipeline akin to the one previously used to automatically annotate objects in ScanNet scenes with their 9D poses and CAD models. This time, we apply it to the recent ScanNet++ v1 dataset, which previously lacked such annotations. Our findings demonstrate that it is not only possible to train deep learning models on these automatically-obtained annotations but that the resulting models outperform those trained on manually annotated data. We validate this on two distinct tasks: point cloud completion and single-view CAD model retrieval and alignment. Our results underscore the potential of automatic 3D annotations to enhance model performance while significantly reducing annotation costs. To support future research in 3D scene understanding, we will release our annotations, which we call SCANnotate++, along with our trained models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。