提出新方法,无需源数据也能高效选关键样本做域适应。
Propensity-driven Uncertainty Learning for Sample Exploration in Source-Free Active Domain Adaptation
- 用特征相似性与相关性评估,智能筛选目标域中最有价值的样本。
- 在四个基准数据集上优于当前最佳方法,提升域适应性能。
- 适合数据隐私敏感或标注成本高的实际场景使用。
无源主动域适应(SFADA)解决预训练模型在无源数据情况下适配新域的问题,同时减少目标域标注需求,适用于数据隐私、存储受限或标注成本高的真实场景。核心挑战包括:从目标域中选择最具有信息量的样本进行标注、有效利用已标注与未标注数据、且不依赖源域信息。现有方法常受噪声或异常样本干扰,且需频繁请求人工标注。为此,本文提出倾向性驱动不确定性学习(ProULearn)框架,引入新颖的同质性倾向估计机制与相关性指数计算,评估特征层级关系,识别代表性与挑战性样本,避免噪声异常点。此外,设计中心相关性损失以优化伪标签,生成紧凑类别分布,有效缩小域间差距并提升适应性能。实验表明,ProULearn在四个基准数据集上均超越现有最优方法。
原文摘要 · Abstract (English)
Source-free active domain adaptation (SFADA) addresses the challenge of adapting a pre-trained model to new domains without access to source data while minimizing the need for target domain annotations. This scenario is particularly relevant in real-world applications where data privacy, storage limitations, or labeling costs are significant concerns. Key challenges in SFADA include selecting the most informative samples from the target domain for labeling, effectively leveraging both labeled and unlabeled target data, and adapting the model without relying on source domain information. Additionally, existing methods often struggle with noisy or outlier samples and may require impractical progressive labeling during training. To effectively select more informative samples without frequently requesting human annotations, we propose the Propensity-driven Uncertainty Learning (ProULearn) framework. ProULearn utilizes a novel homogeneity propensity estimation mechanism combined with correlation index calculation to evaluate feature-level relationships. This approach enables the identification of representative and challenging samples while avoiding noisy outliers. Additionally, we develop a central correlation loss to refine pseudo-labels and create compact class distributions during adaptation. In this way, ProULearn effectively bridges the domain gap and maximizes adaptation performance. The principles of informative sample selection underlying ProULearn have broad implications beyond SFADA, offering benefits across various deep learning tasks where identifying key data points or features is crucial. Extensive experiments on four benchmark datasets demonstrate that ProULearn outperforms state-of-the-art methods in domain adaptation scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。