用少量可信样本和温度调节损失,提升无标签目标域适应效果
Trust And Balance: Few Trusted Samples Pseudo-Labeling and Temperature Scaled Loss for Effective Source-Free Unsupervised Domain Adaptation
- 仅用少量可信目标样本生成伪标签,简化流程并提升精度
- 双温度调度损失函数平衡分类多样性与判别力
- 适合隐私敏感或资源受限场景的域自适应任务
深度神经网络在计算机视觉任务中表现优异,但当测试数据分布(目标域)偏离训练数据分布(源域)时性能下降。在目标标签不可得且源域标注数据受限于隐私或存储限制的情况下,源域无关无监督域自适应(SF-UDA)成为关键工具。本文提出一种新方法——信任与平衡(TAB)适应,包含两项核心贡献:少量可信样本伪标签(FTSP)与温度缩放自适应损失(TSAL)。FTSP利用目标域中少量可信样本构建分类器,为全领域生成伪标签,兼具简洁性与高精度;TSAL采用双温度调度策略,有效平衡无监督适应目标中的多样性、判别力与伪标签融合。该方法在Office31、Office-Home、ImageCLEF-DA及Adaptiope等标准与非标准数据集上验证,使用ResNet50与ViT-Large模型,结果优于多数现有方法,证实其在SF-UDA场景下的有效性。
原文摘要 · Abstract (English)
Deep Neural Networks have significantly impacted many computer vision tasks. However, their effectiveness diminishes when test data distribution (target domain) deviates from the one of training data (source domain). In situations where target labels are unavailable and the access to the labeled source domain is restricted due to data privacy or memory constraints, Source-Free Unsupervised Domain Adaptation (SF-UDA) has emerged as a valuable tool. Recognizing the key role of SF-UDA under these constraints, we introduce a novel approach marked by two key contributions: Few Trusted Samples Pseudo-labeling (FTSP) and Temperature Scaled Adaptive Loss (TSAL). FTSP employs a limited subset of trusted samples from the target data to construct a classifier to infer pseudo-labels for the entire domain, showing simplicity and improved accuracy. Simultaneously, TSAL, designed with a unique dual temperature scheduling, adeptly balance diversity, discriminability, and the incorporation of pseudo-labels in the unsupervised adaptation objective. Our methodology, that we name Trust And Balance (TAB) adaptation, is rigorously evaluated on standard datasets like Office31 and Office-Home, and on less common benchmarks such as ImageCLEF-DA and Adaptiope, employing both ResNet50 and ViT-Large architectures. Our results compare favorably with, and in most cases surpass, contemporary state-of-the-art techniques, underscoring the effectiveness of our methodology in the SF-UDA landscape.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。