arXiv:2410.10510cs.CVcs.RO2024-10中稿 · publication at the…被引 8

用范围图与局部特征提升小数据下点云语义分割速度与精度

Exploiting Local Features and Range Images for Small Data Real-Time Point Cloud Semantic Segmentation

  • 融合范围图与局部特征,利用KDTree加速点云处理
  • 小数据训练仅用1个序列仍达先进水平,实时运行
  • 适合资源受限的自动驾驶、机器人实时场景

点云语义分割对自动驾驶和机器人环境理解至关重要。现有基于距离的方法实现实时效率,而基于点或体素的方法虽性能更优但计算复杂度高。深度学习模型在小数据下易受数据量影响,而非架构设计。本文利用三维表示捕捉局部特征,引入范围图补充信息并加速计算。基于GPU的KDTree实现快速构建、查询与投影操作。在SemanticKITTI和nuScenes数据集上,仅使用一个序列训练的条件下,本方法仍表现优异;在常规训练设置(除一序列外全用于训练)下也取得良好结果。所提简化模型不仅媲美全规模先进模型,且支持实时运行,适用于真实场景。代码已开源:https://github.com/Bender97/WaffleAndRange。

原文摘要 · Abstract (English)

Semantic segmentation of point clouds is an essential task for understanding the environment in autonomous driving and robotics. Recent range-based works achieve real-time efficiency, while point- and voxel-based methods produce better results but are affected by high computational complexity. Moreover, highly complex deep learning models are often not suited to efficiently learn from small datasets. Their generalization capabilities can easily be driven by the abundance of data rather than the architecture design. In this paper, we harness the information from the three-dimensional representation to proficiently capture local features, while introducing the range image representation to incorporate additional information and facilitate fast computation. A GPU-based KDTree allows for rapid building, querying, and enhancing projection with straightforward operations. Extensive experiments on SemanticKITTI and nuScenes datasets demonstrate the benefits of our modification in a ``small data'' setup, in which only one sequence of the dataset is used to train the models, but also in the conventional setup, where all sequences except one are used for training. We show that a reduced version of our model not only demonstrates strong competitiveness against full-scale state-of-the-art models but also operates in real-time, making it a viable choice for real-world case applications. The code of our method is available at https://github.com/Bender97/WaffleAndRange.

点云分割实时处理小样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。