arXiv:2501.01142cs.CV2025-01被引 2

通过自适应难例度量,提升多源域自适应的增强与对齐效果。

Adaptive Hardness-driven Augmentation and Alignment Strategies for Multi-Source Domain Adaptations

  • 基于难例度量动态调整数据增强强度,匹配模型泛化能力。
  • 引入加权聚类MMD,强化跨域对齐的鲁棒性与精度。
  • 自适应构建伪对比矩阵,改善目标域特征聚类质量。

多源域自适应(MDA)旨在将多个带标签源域的知识迁移至无标签目标域。现有方法主要依赖样本级约束(如最大均值差异,MMD)实现域间对齐,忽视了三个关键方面:1)数据增强的潜力,2)域内对齐的重要性,3)聚类级约束的设计。本文提出一种新颖的硬度驱动策略A3MDA,通过自适应硬度量化与利用,在数据增强与域对齐中综合考虑上述三点。A3MDA逐步提出三种自适应硬度测量(AHM):基础、平滑与对比型AHM。基础AHM用于评估每个源/目标样本的即时难度;平滑AHM则根据硬度值自适应调节强数据增强强度,保持与模型泛化能力的兼容性;对比AHM通过硬度值作为样本级权重,将传统MMD扩展为加权聚类版本,增强跨域对齐的稳健性与精确性。对于常被忽略的域内对齐,A3MDA基于硬度排名选择更难样本,自适应构建伪对比矩阵,提升伪标签质量并形成良好聚类的目标特征空间。在多个MDA基准上的实验表明,A3MDA优于现有方法。

原文摘要 · Abstract (English)

Multi-source Domain Adaptation (MDA) aims to transfer knowledge from multiple labeled source domains to an unlabeled target domain. Nevertheless, traditional methods primarily focus on achieving inter-domain alignment through sample-level constraints, such as Maximum Mean Discrepancy (MMD), neglecting three pivotal aspects: 1) the potential of data augmentation, 2) the significance of intra-domain alignment, and 3) the design of cluster-level constraints. In this paper, we introduce a novel hardness-driven strategy for MDA tasks, named "A3MDA" , which collectively considers these three aspects through Adaptive hardness quantification and utilization in both data Augmentation and domain Alignment.To achieve this, "A3MDA" progressively proposes three Adaptive Hardness Measurements (AHM), i.e., Basic, Smooth, and Comparative AHMs, each incorporating distinct mechanisms for diverse scenarios. Specifically, Basic AHM aims to gauge the instantaneous hardness for each source/target sample. Then, hardness values measured by Smooth AHM will adaptively adjust the intensity level of strong data augmentation to maintain compatibility with the model's generalization capacity.In contrast, Comparative AHM is designed to facilitate cluster-level constraints. By leveraging hardness values as sample-specific weights, the traditional MMD is enhanced into a weighted-clustered variant, strengthening the robustness and precision of inter-domain alignment. As for the often-neglected intra-domain alignment, we adaptively construct a pseudo-contrastive matrix by selecting harder samples based on the hardness rankings, enhancing the quality of pseudo-labels, and shaping a well-clustered target feature space. Experiments on multiple MDA benchmarks show that " A3MDA " outperforms other methods.

域自适应数据增强聚类对齐硬样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。