arXiv:2504.01668cs.CVcs.RO2025-04中稿 · the 2025 IEEE/RSJ …被引 1

提升3D语义分割在恶劣环境下的无监督域适应能力

Overlap-Aware Feature Learning for Robust Unsupervised Domain Adaptation for 3D Semantic Segmentation

  • 设计双向注意力对齐模块,抑制特征重叠问题
  • 对比记忆库动态优化伪标签,提升特征判别性
  • 在对抗攻击下实现14.3%的mIoU提升,适合自动驾驶场景

3D点云语义分割是机器人与自动驾驶系统环境感知的核心技术,实现点级分类以精确理解场景。尽管无监督域适应(UDA)缓解了标注稀缺问题,但现有方法严重忽视真实世界扰动(如雪、雾、雨)和对抗性失真带来的脆弱性。本文首次识别出两大内在缺陷:(a) 共享类别区域中未对齐边界导致的特征重叠;(b) 域不变学习削弱目标特有模式引发的特征结构退化。为此,提出三部分框架:(1) 基于鲁棒性指标的评估模型,量化对抗攻击与噪声类型下的抗干扰能力;(2) 可逆注意力对齐模块(IAAM),通过注意力引导抑制重叠,实现双向域映射并保留判别结构;(3) 质量感知对比记忆库,通过渐进式伪标签优化增强特征表示判别性。在SynLiDAR到SemanticPOSS的迁移任务上,对抗攻击下最大mIoU提升达14.3%。

原文摘要 · Abstract (English)

3D point cloud semantic segmentation (PCSS) is a cornerstone for environmental perception in robotic systems and autonomous driving, enabling precise scene understanding through point-wise classification. While unsupervised domain adaptation (UDA) mitigates label scarcity in PCSS, existing methods critically overlook the inherent vulnerability to real-world perturbations (e.g., snow, fog, rain) and adversarial distortions. This work first identifies two intrinsic limitations that undermine current PCSS-UDA robustness: (a) unsupervised features overlap from unaligned boundaries in shared-class regions and (b) feature structure erosion caused by domain-invariant learning that suppresses target-specific patterns. To address the proposed problems, we propose a tripartite framework consisting of: 1) a robustness evaluation model quantifying resilience against adversarial attack/corruption types through robustness metrics; 2) an invertible attention alignment module (IAAM) enabling bidirectional domain mapping while preserving discriminative structure via attention-guided overlap suppression; and 3) a contrastive memory bank with quality-aware contrastive learning that progressively refines pseudo-labels with feature quality for more discriminative representations. Extensive experiments on SynLiDAR-to-SemanticPOSS adaptation demonstrate a maximum mIoU improvement of 14.3\% under adversarial attack.

3D分割无监督学习域适应鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。