用对比学习+多模型伪标签,无标注迁移3D激光雷达语义分割。
Unsupervised Domain Adaptation for 3D LiDAR Semantic Segmentation Using Contrastive Learning and Multi-Model Pseudo Labeling
- 先用片段级对比学习无监督预训练,学鲁棒特征。
- 多模型投票生成高质量伪标签,减少单一模型偏差。
- 在无标注目标域上显著提升分割精度,适合自动驾驶场景。
针对传感器类型、地理位置等导致的3D LiDAR语义分割性能下降问题,本文提出一种无监督域适应(UDA)方法。首先,采用片段级无监督对比学习对主干网络进行预训练,使其学习到不依赖于域的鲁棒特征。随后,引入多模型伪标签策略,集成多种先进架构(投影式、体素式、混合式、圆柱式)的预测结果,通过硬投票生成高质量、精细化的伪标签,以缓解单模型偏差。再将对比预训练网络在这些可靠伪标签上微调。在从SemanticKITTI迁移到无标注目标数据集(SemanticPOSS、SemanticSlamantic)的实验中,该方法显著优于直接迁移和单模型UDA方法,验证了结合对比预训练与集成伪标签在无目标域标注条件下有效弥合复杂域差异的能力。
原文摘要 · Abstract (English)
Addressing performance degradation in 3D LiDAR semantic segmentation due to domain shifts (e.g., sensor type, geographical location) is crucial for autonomous systems, yet manual annotation of target data is prohibitive. This study addresses the challenge using Unsupervised Domain Adaptation (UDA) and introduces a novel two-stage framework to tackle it. Initially, unsupervised contrastive learning at the segment level is used to pre-train a backbone network, enabling it to learn robust, domain-invariant features without labels. Subsequently, a multi-model pseudo-labeling strategy is introduced, utilizing an ensemble of diverse state-of-the-art architectures (including projection, voxel, hybrid, and cylinder-based methods). Predictions from these models are aggregated via hard voting to generate high-quality, refined pseudo-labels for the unlabeled target domain, mitigating single-model biases. The contrastively pre-trained network is then fine-tuned using these robust pseudo-labels. Experiments adapting from SemanticKITTI to unlabeled target datasets (SemanticPOSS, SemanticSlamantic) demonstrate significant improvements in segmentation accuracy compared to direct transfer and single-model UDA approaches. These results highlight the effectiveness of combining contrastive pre-training with refined ensemble pseudo-labeling for bridging complex domain gaps without requiring target domain annotations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。