无需训练,基于几何关系实现4D激光雷达语义分割的高效关联
Training-Free Global Geometric Association for 4D LiDAR Panoptic Segmentation
- 通过点集间最优变换建立全局几何关联
- 在SemanticKITTI和nuScenes上超越现有方法
- 适合追求高效、无训练依赖的自动驾驶感知系统
现有的4D激光雷达全景分割方法通常依赖大规模点云上的深度神经网络训练或设计专用模块进行实例关联,导致计算开销大,且忽视原始点云中蕴含的丰富几何先验。为此,我们提出 extsc{Geo-4D},一种简单有效的免训练框架,统一时空推理,实现长时序下的整体激光雷达感知。具体地,提出全局几何关联策略,通过估计实例级点集间的最优变换建立一致的实例对应关系;为缓解观测中结构不一致带来的不稳定问题,设计全局几何感知的软匹配机制,基于实例点集的空间分布强制空间一致的点对点对应。此外,精心设计的流水线考虑静态、动态和缺失三类实例,兼顾计算效率与遮挡感知匹配。在SemanticKITTI和nuScenes上的大量实验表明,本方法即使无需额外训练或输入点云,也持续优于当前最优方法。
原文摘要 · Abstract (English)
Dominant paradigms for 4D LiDAR panoptic segmentation are usually required to train deep neural networks with large superimposed point clouds or design dedicated modules for instance association. However, these approaches perform redundant point processing and consequently become computationally expensive, yet still overlook the rich geometric priors inherently provided by raw point clouds. To this end, we introduce \textsc{Geo-4D}, a simple yet effective training-free framework that unifies spatial and temporal reasoning, enabling holistic LiDAR perception over long time horizons. Specifically, we propose a global geometric association strategy that establishes consistent instance correspondences by estimating an optimal transformation between instance-level point sets. To mitigate instability caused by structural inconsistencies in point cloud observations, we propose a global geometry-aware soft matching mechanism that enforces spatially coherent point-wise correspondences grounded in the spatial distribution of instance point sets. Furthermore, our carefully designed pipeline, which considers three instance types-static, dynamic, and missing-offers computational efficiency and occlusion-aware matching. Our extensive experiments across both SemanticKITTI and nuScenes demonstrate that our method consistently outperforms state-of-the-art approaches, even without additional training or extra point cloud inputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。