arXiv:2411.15976cs.CVcs.AI2024-11

通过双模型对抗与熵感知伪标签提升无源域适应的鲁棒性

DRIVE: Dual-Robustness via Information Variability and Entropic Consistency in Source-Free Unsupervised Domain Adaptation

  • 双模型并行架构,一个受信息引导扰动,捕捉不确定区域
  • 引入熵感知伪标签,自动调节预测不确定性高的样本权重
  • 分阶段优化:先对齐稳定特征,再动态调整扰动强度以增强泛化

在无源无监督域适应(SFUDA)中,模型需仅用无标签目标域数据适应新场景,常见于医学影像、自动驾驶和遥感等应用。现有方法多依赖单模型,难以应对目标域中的不确定性和噪声。为此,本文提出DRIVE框架,采用双模型架构,初始权重相同,协同捕捉目标域多样性。一个模型通过基于互信息的投影梯度下降(PGD)施加扰动,聚焦高不确定性区域;同时设计熵感知伪标签策略,依据预测不确定性动态调整标签权重,避免噪声干扰。适应过程分为两阶段:第一阶段利用互信息一致性损失对齐模型在稳定特征上的表现;第二阶段根据第一阶段损失动态调节扰动强度,促使模型探索更广泛的目标域空间,同时维持性能。在标准SFUDA基准上,DRIVE持续优于以往方法,在复杂目标域中实现更高的适应准确率与稳定性。

原文摘要 · Abstract (English)

Adapting machine learning models to new domains without labeled data, especially when source data is inaccessible, is a critical challenge in applications like medical imaging, autonomous driving, and remote sensing. This task, known as Source-Free Unsupervised Domain Adaptation (SFUDA), involves adapting a pre-trained model to a target domain using only unlabeled target data, which can lead to issues such as overfitting, underfitting, and poor generalization due to domain discrepancies and noise. Existing SFUDA methods often rely on single-model architectures, struggling with uncertainty and variability in the target domain. To address these challenges, we propose DRIVE (Dual-Robustness through Information Variability and Entropy), a novel SFUDA framework leveraging a dual-model architecture. The two models, initialized with identical weights, work in parallel to capture diverse target domain characteristics. One model is exposed to perturbations via projection gradient descent (PGD) guided by mutual information, focusing on high-uncertainty regions. We also introduce an entropy-aware pseudo-labeling strategy that adjusts label weights based on prediction uncertainty, ensuring the model focuses on reliable data while avoiding noisy regions. The adaptation process has two stages: the first aligns the models on stable features using a mutual information consistency loss, and the second dynamically adjusts the perturbation level based on the loss from the first stage, encouraging the model to explore a broader range of the target domain while preserving existing performance. This enhances generalization capabilities and robustness against interference. Evaluations on standard SFUDA benchmarks show that DRIVE consistently outperforms previous methods, delivering improved adaptation accuracy and stability across complex target domains.

无源域适应双模型熵感知鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。