针对恶劣天气下激光雷达语义分割中‘物体’类别易误判的问题,提出新方法提升安全关键类别的鲁棒性。
No Thing, Nothing: Highlighting Safety-Critical Classes for Robust LiDAR Semantic Segmentation in Adverse Weather

- 通过绑定点特征与超类,防止物体被错分为视觉相似度低的类别。
- 在恶劣天气下,对'物体'类别的平均交并比提升4.8和7.9点。
- 特别适合自动驾驶中需高精度识别动态障碍物的场景。
现有恶劣天气下激光雷达语义分割的领域泛化方法在预测'物体'类别时表现较差,而'物体'类通常具有动态性且与更高碰撞风险相关,对安全导航至关重要。我们发现性能下降主要源于语义级特征退化及局部特征污染,导致'物体'被误判为'东西'类。为此,提出NTN(segmeNt Things for No-accident)方法:通过将每个点特征绑定其超类,防止物体被误归入视觉差异大的类别;同时,以每束激光为局部区域,引入正则项使干净数据与受损数据在特征空间对齐。NTN在SemanticKITTI-to-SemanticSTF基准上实现+2.6 mIoU,在SemanticPOSS-to-SemanticSTF上达+7.9 mIoU,尤其在'物体'类别上分别提升+4.8和+7.9 mIoU,显著改善了安全关键类别的分割精度。
原文摘要 · Abstract (English)
Existing domain generalization methods for LiDAR semantic segmentation under adverse weather struggle to accurately predict "things" categories compared to "stuff" categories. In typical driving scenes, "things" categories can be dynamic and associated with higher collision risks, making them crucial for safe navigation and planning. Recognizing the importance of "things" categories, we identify their performance drop as a serious bottleneck in existing approaches. We observed that adverse weather induces degradation of semantic-level features and both corruption of local features, leading to a misprediction of "things" as "stuff". To mitigate these corruptions, we suggest our method, NTN - segmeNt Things for No-accident. To address semantic-level feature corruption, we bind each point feature to its superclass, preventing the misprediction of things classes into visually dissimilar categories. Additionally, to enhance robustness against local corruption caused by adverse weather, we define each LiDAR beam as a local region and propose a regularization term that aligns the clean data with its corrupted counterpart in feature space. NTN achieves state-of-the-art performance with a +2.6 mIoU gain on the SemanticKITTI-to-SemanticSTF benchmark and +7.9 mIoU on the SemanticPOSS-to-SemanticSTF benchmark. Notably, NTN achieves a +4.8 and +7.9 mIoU improvement on "things" classes, respectively, highlighting its effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。