通过图像退化构建中间域,提升语义分割在不同场景下的泛化能力。
Towards Unsupervised Domain Bridging via Image Degradation in Semantic Segmentation
- 用图像退化生成连续中间域,逐步缩小源域与目标域差异。
- 引入扩散编码器补偿语义偏移,保留关键特征表示。
- 可插拔设计,适配多种退化方式和现有无监督方法。
语义分割模型在跨域应用时性能显著下降。为解决此问题,无监督域自适应(UDA)被广泛研究。尽管自训练技术有效,但常忽略对共享特征的显式建模。本文提出DiDA,一种面向语义分割的无监督域桥接方法。DiDA包含两个核心模块:(1) 基于退化的中间域构建,通过简单图像退化操作生成连续中间域,促使模型学习随域差异渐变而稳定的域不变特征;(2) 语义偏移补偿,利用扩散编码器在退化时间步上解耦并补偿语义偏移信息,保持中间域中判别性表征。作为即插即用方案,DiDA支持多种退化操作,并可无缝集成至现有UDA方法。在多个跨域语义分割基准上的实验表明,DiDA在所有设置下均实现显著性能提升。代码已公开于https://github.com/Woof6/DiDA。
原文摘要 · Abstract (English)
Semantic segmentation suffers from significant performance degradation when the trained network is applied to a different domain. To address this issue, unsupervised domain adaptation (UDA) has been extensively studied. Despite the effectiveness of selftraining techniques in UDA, they still overlook the explicit modeling of domain-shared feature extraction. In this paper, we propose DiDA, an unsupervised domain bridging approach for semantic segmentation. DiDA consists of two key modules: (1) Degradation-based Intermediate Domain Construction, which creates continuous intermediate domains through simple image degradation operations to encourage learning domain-invariant features as domain differences gradually diminish; (2) Semantic Shift Compensation, which leverages a diffusion encoder to disentangle and compensate for semantic shift information with degraded timesteps, preserving discriminative representations in the intermediate domains. As a plug-and-play solution, DiDA supports various degradation operations and seamlessly integrates with existing UDA methods. Extensive experiments on multiple domain adaptive semantic segmentation benchmarks demonstrate that DiDA consistently achieves significant performance improvements across all settings. Code is available at https://github.com/Woof6/DiDA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。