分两阶段提升未知类别识别能力,解决模型偏倚问题。
In defense of the two-stage framework for open-set domain adaptive semantic segmentation
- 先分离已知/未知类别,再进行适配训练
- 在GTA5→Cityscapes上提升3.85%的H-Score
- 适合关注未知类检测与鲁棒性提升的研究者
开放集语义分割领域自适应(OSDA-SS)面临双重挑战:既要对已知类别进行域适应,又要识别未知类别。现有方法将两者合并于单一阶段,但因已知与未知类别标注失衡,常导致已知类负迁移和未知类欠拟合。为此,本文提出SATs(分离后适配训练策略),通过两个连续步骤——已知/未知分离与面向未知的域适应——实现更平衡的学习。该策略提升了未知类别的准确性和对齐度,使模型能更好发现真正未知对象。此外,提出硬未知探索数据增强方法,让模型接触更具挑战性的未知样本,增强其对目标未知类别的全面理解。在公开的OSDA-SS基准上评估,结果表明本方法在GTA5→Cityscapes上实现+3.85%的H-Score提升,在SYNTHIA→Cityscapes上达+18.64%,超越现有最先进方法。
原文摘要 · Abstract (English)
Open-Set Domain Adaptation for Semantic Segmentation (OSDA-SS) presents a significant challenge, as it requires both domain adaptation for known classes and the distinction of unknowns. Existing methods attempt to address both tasks within a single unified stage. We question this design, as the annotation imbalance between known and unknown classes often leads to negative transfer of known classes and underfitting for unknowns. To overcome these issues, we propose SATS, a Separating-then-Adapting Training Strategy, which addresses OSDA-SS through two sequential steps: known/unknown separation and unknown-aware domain adaptation. By providing the model with more accurate and well-aligned unknown classes, our method ensures a balanced learning of discriminative features for both known and unknown classes, steering the model toward discovering truly unknown objects. Additionally, we present hard unknown exploration, an innovative data augmentation method that exposes the model to more challenging unknowns, strengthening its ability to capture more comprehensive understanding of target unknowns. We evaluate our method on public OSDA-SS benchmarks. Experimental results demonstrate that our method achieves a substantial advancement, with a +3.85% H-Score improvement for GTA5-to-Cityscapes and +18.64% for SYNTHIA-to-Cityscapes, outperforming previous state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。