arXiv:2409.19542cs.CV2024-09被引 4

用双向概率校准提升无监督域适应性能,适配多种网络结构

BiPC: Bidirectional Probability Calibration for Unsupervised Domain Adaption

论文配图:BiPC: Bidirectional Probability Calibration for Unsupervised Domain Adaption
图 1 · 摘自论文原文
  • 从概率空间出发,利用预训练头的稳健输出校准任务头分布
  • 在多个域适应任务中显著提升性能,尤其对CNN与Transformer通用
  • 方法简单有效,适合追求高鲁棒性的模型部署场景

无监督域适应(UDA)利用有标签源域数据解决无标签目标域的任务。尽管基于Transformer的方法在UDA中表现良好,但其应用受限于纯Transformer架构,难以兼容卷积神经网络(CNN)和层次化Transformer。为此,本文从概率空间视角提出双向概率校准(BiPC)。我们证明,经过大规模预训练的预训练头的概率输出对域间差异具有鲁棒性,可用来调节任务头的概率分布;同时,任务头在适应训练中也能反向增强预训练头,实现双向互补。技术上,引入校准概率对齐(CPA)以调整预训练头输出(如ImageNet-1k预训练分类器),并设计校准吉尼不纯度(CGI)损失来优化任务头,其中校准系数由预训练分类器学习得到。该方法简单高效,适用于多种网络结构。实验表明,其在多个UDA任务中均表现出色。代码将开源于:https://github.com/Wenlve-Zhou/BiPC。

原文摘要 · Abstract (English)

Unsupervised Domain Adaptation (UDA) leverages a labeled source domain to solve tasks in an unlabeled target domain. While Transformer-based methods have shown promise in UDA, their application is limited to plain Transformers, excluding Convolutional Neural Networks (CNNs) and hierarchical Transformers. To address this issues, we propose Bidirectional Probability Calibration (BiPC) from a probability space perspective. We demonstrate that the probability outputs from a pre-trained head, after extensive pre-training, are robust against domain gaps and can adjust the probability distribution of the task head. Moreover, the task head can enhance the pre-trained head during adaptation training, improving model performance through bidirectional complementation. Technically, we introduce Calibrated Probability Alignment (CPA) to adjust the pre-trained head's probabilities, such as those from an ImageNet-1k pre-trained classifier. Additionally, we design a Calibrated Gini Impurity (CGI) loss to refine the task head, with calibrated coefficients learned from the pre-trained classifier. BiPC is a simple yet effective method applicable to various networks, including CNNs and Transformers. Experimental results demonstrate its remarkable performance across multiple UDA tasks. Our code will be available at: https://github.com/Wenlve-Zhou/BiPC.

域适应概率校准CNNTransformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。