解决目标域语义分割中类别不平衡问题,提升小类识别效果
Balanced Learning for Domain Adaptive Semantic Segmentation
- 通过分析预测置信度分布,识别过预测和欠预测类别
- 引入共享锚点分布对齐各类别置信度,提升小类性能
- 无需先验知识,可兼容多种现有方法,适合长尾场景
无监督域适应(UDA)旨在将带标签源域的知识迁移到无标签目标域。尽管自训练技术在UDA中有效,但因类别不平衡及数据与标签空间的分布偏移,难以实现各分类均衡学习。为此,本文提出平衡域适应学习(BLDA),一种无需先验分布信息即可直接评估并缓解类别偏差的新方法。首先,通过分析预测置信度分布识别过预测与欠预测类别;随后,引入后处理方法,利用共享锚点分布对齐不同类别的置信度分布;为保障自训练中伪标签的无偏性,在线估计置信度分布,并将校正项融入损失函数;同时,利用累积分布作为域间共享结构知识,连接源与目标域。在两个标准的UDA语义分割基准上大量实验表明,BLDA能持续提升性能,尤其显著改善欠预测类别的表现,且可集成至多种现有方法。代码已开源。
原文摘要 · Abstract (English)
Unsupervised domain adaptation (UDA) for semantic segmentation aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Despite the effectiveness of self-training techniques in UDA, they struggle to learn each class in a balanced manner due to inherent class imbalance and distribution shift in both data and label space between domains. To address this issue, we propose Balanced Learning for Domain Adaptation (BLDA), a novel approach to directly assess and alleviate class bias without requiring prior knowledge about the distribution shift. First, we identify over-predicted and under-predicted classes by analyzing the distribution of predicted logits. Subsequently, we introduce a post-hoc approach to align the logits distributions across different classes using shared anchor distributions. To further consider the network's need to generate unbiased pseudo-labels during self-training, we estimate logits distributions online and incorporate logits correction terms into the loss function. Moreover, we leverage the resulting cumulative density as domain-shared structural knowledge to connect the source and target domains. Extensive experiments on two standard UDA semantic segmentation benchmarks demonstrate that BLDA consistently improves performance, especially for under-predicted classes, when integrated into various existing methods. Code is available at https://github.com/Woof6/BLDA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。