arXiv:2409.04234cs.CV2024-09被引 31

融合多数据集训练,提升室内3D目标检测泛化能力

UniDet3D: Multi-dataset Indoor 3D Object Detection

  • 用统一标签空间联合训练多个室内数据集
  • 在6个基准上平均提升超9%的检测精度
  • 架构简单易扩展,适合实际部署场景

随着机器人和增强现实领域对智能解决方案的需求增长,点云中的3D目标检测受到广泛关注。然而,现有单个室内数据集规模小且多样性不足,难以训练出强大通用的3D检测模型。同时,基于基础模型的通用方法在性能上仍逊于特定任务的监督训练方法。本文提出 oots{},一种简单有效的3D目标检测模型,通过混合多个室内数据集进行训练,可适应多种室内环境。通过统一不同数据集的标签空间, oots{}实现了跨数据集的监督联合训练,从而学习强表征。网络架构基于原始Transformer编码器,便于运行、定制与扩展预测流程。大量实验表明, oots{}在6个室内基准上均取得显著提升:ScanNet(+1.1 mAP50)、ARKitScenes(+19.4 mAP25)、S3DIS(+9.1 mAP50)、MultiScan(+9.3 mAP50)、3RScan(+3.2 mAP50)和ScanNet++(+2.7 mAP50)。代码已开源。

原文摘要 · Abstract (English)

Growing customer demand for smart solutions in robotics and augmented reality has attracted considerable attention to 3D object detection from point clouds. Yet, existing indoor datasets taken individually are too small and insufficiently diverse to train a powerful and general 3D object detection model. In the meantime, more general approaches utilizing foundation models are still inferior in quality to those based on supervised training for a specific task. In this work, we propose \ours{}, a simple yet effective 3D object detection model, which is trained on a mixture of indoor datasets and is capable of working in various indoor environments. By unifying different label spaces, \ours{} enables learning a strong representation across multiple datasets through a supervised joint training scheme. The proposed network architecture is built upon a vanilla transformer encoder, making it easy to run, customize and extend the prediction pipeline for practical use. Extensive experiments demonstrate that \ours{} obtains significant gains over existing 3D object detection methods in 6 indoor benchmarks: ScanNet (+1.1 mAP50), ARKitScenes (+19.4 mAP25), S3DIS (+9.1 mAP50), MultiScan (+9.3 mAP50), 3RScan (+3.2 mAP50), and ScanNet++ (+2.7 mAP50). Code is available at https://github.com/filapro/unidet3d .

3D检测点云多数据集Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。