用伪源域作语义桥梁,提升未知目标域的模型适应能力
Semantic Bridging Domains: Pseudo-Source as Test-Time Connector
- 将伪源域视为连接源与目标的语义桥梁,而非直接替代
- 在无源域、无标签目标时实现5.2%性能提升
- 适合真实场景中分布漂移的模型自适应任务
训练与测试数据间的分布偏移是限制模型实用性的关键瓶颈,尤其在实际测试时。当源域未知且目标域无标签时,以往方法通过数据生成与翻译构建伪源域,并将其与目标域对齐。然而,伪源域与原始源域存在显著差异,直接纠正目标域可能导致偏差。为此,本文提出分步语义对齐(SSA)方法,将伪源域视为连接源与目标的语义桥梁。具体地,利用易获取的通用语义修正伪源域的语义特征,再以修正后的伪源语义对齐目标域。此外,引入层次化特征聚合(HFA)模块与置信度感知互补学习(CACL)策略,提升无源域与无目标真值条件下的语义质量。我们在语义分割与图像分类任务上验证了该方法,在GTA2Cityscapes上相比当前最优方案提升5.2%。
原文摘要 · Abstract (English)
Distribution shifts between training and testing data are a critical bottleneck limiting the practical utility of models, especially in real-world test-time scenarios. To adapt models when the source domain is unknown and the target domain is unlabeled, previous works constructed pseudo-source domains via data generation and translation, then aligned the target domain with them. However, significant discrepancies exist between the pseudo-source and the original source domain, leading to potential divergence when correcting the target directly. From this perspective, we propose a Stepwise Semantic Alignment (SSA) method, viewing the pseudo-source as a semantic bridge connecting the source and target, rather than a direct substitute for the source. Specifically, we leverage easily accessible universal semantics to rectify the semantic features of the pseudo-source, and then align the target domain using the corrected pseudo-source semantics. Additionally, we introduce a Hierarchical Feature Aggregation (HFA) module and a Confidence-Aware Complementary Learning (CACL) strategy to enhance the semantic quality of the SSA process in the absence of source and ground truth of target domains. We evaluated our approach on tasks like semantic segmentation and image classification, achieving a 5.2% performance boost on GTA2Cityscapes over the state-of-the-art.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。