arXiv:2505.22458cs.CV2025-05CVPR被引 8

解决无监督语义分割中类别未知时的域适应问题,提升模型鲁棒性。

Universal Domain Adaptation for Semantic Segmentation

  • 通过领域特定原型与图像匹配,区分共现类与私有类特征
  • 在新基准上达到4.3%平均精度提升,显著优于基线方法
  • 适合实际场景中类别信息未知的语义分割应用

无监督域适应语义分割(UDA-SS)旨在将标注源域知识迁移到未标注目标域。传统方法假设源域与目标域类别设置已知,但在真实场景中这一假设不成立,存在私有类时性能会下降。为此,本文提出通用域适应语义分割(UniDA-SS),在未知类别设置下仍能实现稳健适应。定义问题为:目标域中常见类置信度低,易与私有类混淆。提出UniMAP框架,包含两个核心组件:一是领域特定原型区分(DSPD),将每类划分为两个领域特定原型,细化领域特征分离,增强跨域常见类识别;二是基于目标的图像匹配(TIM),依据目标伪标签选择含最多常见类像素的源图像,在批次内配对,促进常见类有效学习。构建新UniDA-SS基准,实验表明UniMAP显著优于基线,在多个数据集上平均提升4.3% mIoU。

原文摘要 · Abstract (English)

Unsupervised domain adaptation for semantic segmentation (UDA-SS) aims to transfer knowledge from labeled source data to unlabeled target data. However, traditional UDA-SS methods assume that category settings between source and target domains are known, which is unrealistic in real-world scenarios. This leads to performance degradation if private classes exist. To address this limitation, we propose Universal Domain Adaptation for Semantic Segmentation (UniDA-SS), achieving robust adaptation even without prior knowledge of category settings. We define the problem in the UniDA-SS scenario as low confidence scores of common classes in the target domain, which leads to confusion with private classes. To solve this problem, we propose UniMAP: UniDA-SS with Image Matching and Prototype-based Distinction, a novel framework composed of two key components. First, Domain-Specific Prototype-based Distinction (DSPD) divides each class into two domain-specific prototypes, enabling finer separation of domain-specific features and enhancing the identification of common classes across domains. Second, Target-based Image Matching (TIM) selects a source image containing the most common-class pixels based on the target pseudo-label and pairs it in a batch to promote effective learning of common classes. We also introduce a new UniDA-SS benchmark and demonstrate through various experiments that UniMAP significantly outperforms baselines. The code is available at https://github.com/KU-VGI/UniMAP.

域适应语义分割通用迁移图像匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。