提出新框架缓解无源域适应中的负迁移和域偏移问题。
Attention Residual Fusion Network with Contrast for Source-free Domain Adaptation
- 通过注意力残差融合捕捉目标物体关键区域
- 利用全局局部对比提升类别间区分能力,准确率最高达85.6%
- 动态中心评估策略自监督优化伪标签,适合跨域图像分类任务
无源域适应(SFDA)指在训练阶段使用源域数据,但在适配目标域时无法访问源域数据与标签。场景信息复杂且缺乏源域数据,使该任务极具挑战。现有方法多关注域偏移,却忽视负迁移影响,可能阻碍模型性能提升。本文提出注意力残差融合网络(ARFNet),基于对比学习设计,以缓解适配过程中的负迁移与域偏移。具体包括:1)引入注意力机制提取目标物体判别区域;2)在每层分解空间与通道注意力,实现跨层注意力残差融合与自蒸馏;3)对比全局与局部表示,增强不同类别感知能力,有效区分类内与类间差异;4)采用动态中心评估策略,自监督地筛选可信中心点与伪标签,以逼近源域中心并降低域偏移。在五个不同规模的基准上进行大量实验,结果表明本方法在各项指标上均优于现有技术,最高准确率达85.6%。
原文摘要 · Abstract (English)
Source-free domain adaptation (SFDA) involves training a model on source domain and then applying it to a related target domain without access to the source data and labels during adaptation. The complexity of scene information and lack of the source domain make SFDA a difficult task. Recent studies have shown promising results, but many approaches to domain adaptation concentrate on domain shift and neglect the effects of negative transfer, which may impede enhancements of model performance during adaptation. n this paper, addressing this issue, we propose a novel framework of Attention Residual Fusion Network (ARFNet) based on contrast learning for SFDA to alleviate negative transfer and domain shift during the progress of adaptation, in which attention residual fusion, global-local attention contrast, and dynamic centroid evaluation are exploited. Concretely, the attention mechanism is first exploited to capture the discriminative region of the target object. Then, in each block, attention features are decomposed into spatial-wise and channel-wise attentions to achieve the cross-layer attention residual fusion progressively and self-distillation. During adaptation progress, we contrast global and local representations to improve the perceptual capabilities of different categories, which enables the model to discriminate variations between inner-class and intra-class. Finally, a dynamic centroid evaluation strategy is exploited to evaluate the trustworthy centroids and labels for self-supervised self-distillation, which aims to accurately approximate the center of the source domain and pseudo-labels to mitigate domain shift. To validate the efficacy, we execute comprehensive experiments on five benchmarks of varying scales. Experimental outcomes indicate that our method surpasses other techniques, attaining superior performance across SFDA benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。