arXiv:2410.08206cs.CV2024-10ICRA被引 6

一次性标注多帧激光雷达数据中的多个物体,提升标注效率。

Interactive4D: Interactive 4D LiDAR Segmentation

论文配图:Interactive4D: Interactive 4D LiDAR Segmentation
图 1 · 摘自论文原文
  • 基于时空体联合建模,单次迭代完成多帧多物体分割。
  • 在多个数据集上达到新最好性能,显著超越已有方法。
  • 专为激光雷达设计点击模拟策略,适合实际交互标注场景。

交互式分割在构建未来激光雷达数据集的标注过程中具有重要意义。现有方法在每帧激光雷达扫描中逐个分割物体,重复整个序列处理,存在冗余且低效的问题。本文提出交互式4D分割新范式,首次实现通过单次迭代,在叠加的连续激光雷达扫描中同时分割多个物体,利用激光雷达数据的时序特性。模型在4D时空体上操作,实现跨时间的一致实例编号,并简化跟踪标注。实验表明,点击模拟对模型训练至关重要,为此设计了更适配激光雷达特性的点击模拟策略。在多个激光雷达数据集上评估,Interactive4D以显著优势达到当前最优性能。代码与模型已公开:https://vision.rwth-aachen.de/Interactive4D。

原文摘要 · Abstract (English)

Interactive segmentation has an important role in facilitating the annotation process of future LiDAR datasets. Existing approaches sequentially segment individual objects at each LiDAR scan, repeating the process throughout the entire sequence, which is redundant and ineffective. In this work, we propose interactive 4D segmentation, a new paradigm that allows segmenting multiple objects on multiple LiDAR scans simultaneously, and Interactive4D, the first interactive 4D segmentation model that segments multiple objects on superimposed consecutive LiDAR scans in a single iteration by utilizing the sequential nature of LiDAR data. While performing interactive segmentation, our model leverages the entire space-time volume, leading to more efficient segmentation. Operating on the 4D volume, it directly provides consistent instance IDs over time and also simplifies tracking annotations. Moreover, we show that click simulations are crucial for successful model training on LiDAR point clouds. To this end, we design a click simulation strategy that is better suited for the characteristics of LiDAR data. To demonstrate its accuracy and effectiveness, we evaluate Interactive4D on multiple LiDAR datasets, where Interactive4D achieves a new state-of-the-art by a large margin. We publicly release the code and models at https://vision.rwth-aachen.de/Interactive4D.

激光雷达交互分割4D建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。