通过聚类先验提升4D激光雷达语义分割一致性,显著改善物体误分问题。
4D-CS: Exploiting Cluster Prior for 4D Spatio-Temporal LiDAR Semantic Segmentation
- 引入跨帧聚类标签,显式约束空间时间一致性
- 双分支网络融合点与聚类特征,在SemanticKITTI上达最新性能
- 适合自动驾驶中动态物体分割与复杂场景建模
LiDAR点云语义分割对自动驾驶和移动机器人系统具有重要意义。现有方法虽利用多帧时空信息识别点的语义类别与运动状态,但常忽视空间时间上的分割一致性,导致同一物体内的点被分到不同类别。为此,本文提出4D-CS,核心思想是生成跨多帧的聚类标签,反映物体完整空间结构与时间信息。这些标签作为显式引导,输入双分支网络:点分支通过多视图时序融合增强当前特征;聚类分支提出新策略生成前景聚类标签,并用于聚合点信息以提取聚类特征。随后,跨扫描合并邻近聚类以恢复遮挡导致的缺失特征。最后在点-聚类融合阶段自适应融合双分支信息,优化分割结果。大量实验验证方法有效性,在SemanticKITTI和nuScenes多帧语义分割及动体分割任务上达到领先性能。代码将开源于https://github.com/NEU-REAL/4D-CS.git。
原文摘要 · Abstract (English)
Semantic segmentation of LiDAR points has significant value for autonomous driving and mobile robot systems. Most approaches explore spatio-temporal information of multi-scan to identify the semantic classes and motion states for each point. However, these methods often overlook the segmentation consistency in space and time, which may result in point clouds within the same object being predicted as different categories. To handle this issue, our core idea is to generate cluster labels across multiple frames that can reflect the complete spatial structure and temporal information of objects. These labels serve as explicit guidance for our dual-branch network, 4D-CS, which integrates point-based and cluster-based branches to enable more consistent segmentation. Specifically, in the point-based branch, we leverage historical knowledge to enrich the current feature through temporal fusion on multiple views. In the cluster-based branch, we propose a new strategy to produce cluster labels of foreground objects and apply them to gather point-wise information to derive cluster features. We then merge neighboring clusters across multiple scans to restore missing features due to occlusion. Finally, in the point-cluster fusion stage, we adaptively fuse the information from the two branches to optimize segmentation results. Extensive experiments confirm the effectiveness of the proposed method, and we achieve state-of-the-art results on the multi-scan semantic and moving object segmentation on SemanticKITTI and nuScenes datasets. The code will be available at https://github.com/NEU-REAL/4D-CS.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。