用对比学习提升遥感图像分割的无监督域适应效果
SiamSeg: Self-Training with Contrastive Learning for Unsupervised Domain Adaptation Semantic Segmentation in Remote Sensing
- 通过对比学习增强目标域图像的语义表征能力
- 在Potsdam、Vaihingen和LoveDA数据集上达到最优性能
- 适合遥感图像分割与跨域适应研究者使用
遥感图像语义分割是具有广泛应用的重要任务,但高质量标注数据获取成本高。无监督域适应(UDA)可通过利用源域标注数据和目标域未标注数据来缓解此问题。尽管自训练(ST)方法在生成伪标签方面有潜力,但在遥感图像中因采样距离、设备差异和地理多样性导致的域偏移仍使其表现受限。为此,本文提出SiamSeg:将对比学习引入UDA,通过最大化同一图像不同增强视图间的相似性,增强模型对目标域语义信息的捕捉能力。该额外监督提升了模型的表示能力和分割精度。在Potsdam、Vaihingen和LoveDA等遥感数据集上的大量实验表明,SiamSeg优于现有方法,达到当前最佳结果。可视化与定量分析进一步验证其在目标域学习中的优越性。代码已公开于https://github.com/woldier/SiamSeg。
原文摘要 · Abstract (English)
Semantic segmentation of remote sensing (RS) images is a challenging yet essential task with broad applications. While deep learning, particularly supervised learning with large-scale labeled datasets, has significantly advanced this field, the acquisition of high-quality labeled data remains costly and time-intensive. Unsupervised domain adaptation (UDA) provides a promising alternative by enabling models to learn from unlabeled target domain data while leveraging labeled source domain data. Recent self-training (ST) approaches employing pseudo-label generation have shown potential in mitigating domain discrepancies. However, the application of ST to RS image segmentation remains underexplored. Factors such as variations in ground sampling distance, imaging equipment, and geographic diversity exacerbate domain shifts, limiting model performance across domains. In that case, existing ST methods, due to significant domain shifts in cross-domain RS images, often underperform. To address these challenges, we propose integrating contrastive learning into UDA, enhancing the model's ability to capture semantic information in the target domain by maximizing the similarity between augmented views of the same image. This additional supervision improves the model's representational capacity and segmentation performance in the target domain. Extensive experiments conducted on RS datasets, including Potsdam, Vaihingen, and LoveDA, demonstrate that our method, SimSeg, outperforms existing approaches, achieving state-of-the-art results. Visualization and quantitative analyses further validate SimSeg's superior ability to learn from the target domain. The code is publicly available at https://github.com/woldier/SiamSeg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。