提出双一致性机制,提升模型在无源数据下的持续自适应能力
DCFS: Continual Test-Time Adaptation via Dual Consistency of Feature and Sample
- 分离语义与领域特征,通过双路径保持特征一致性
- 自适应阈值结合置信度评分,有效抑制伪标签噪声
- 适用于持续测试时自适应场景,尤其适合复杂分布数据
持续测试时自适应旨在不访问源域数据的情况下,将预训练模型持续适配到目标域数据流。由于无法获取源数据,模型仅依赖目标数据的特征特性,易引发混淆并引入学习偏差。现有方法多通过模型预测生成伪标签,但其质量难以保证,且存在误差累积问题。为此,本文提出DCFS框架,引入双路径特征一致性和置信度感知样本学习。该框架利用双分类器将目标数据的整体特征解耦为语义相关特征与领域相关特征,分别学习独立表征,并通过子特征与整体特征间的一致性约束,实现多视角特征捕获。此外,为避免忽略目标样本的整体特征信息,设定自适应阈值并计算每个样本的置信度得分,实施加权自监督学习,有效降低伪标签噪声,缓解误差累积。在CIFAR10-C、CIFAR100-C和ImageNet-C等多个数据集上进行大量实验验证了方法的有效性,在持续测试时自适应场景中表现稳定。
原文摘要 · Abstract (English)
Continual test-time adaptation aims to continuously adapt a pre-trained model to a stream of target domain data without accessing source data. Without access to source domain data, the model focuses solely on the feature characteristics of the target data. Relying exclusively on these features can lead to confusion and introduce learning biases. Currently, many existing methods generate pseudo-labels via model predictions. However, the quality of pseudo-labels cannot be guaranteed and the problem of error accumulation must be solved. To address these challenges, we propose DCFS, a novel CTTA framework that introduces dual-path feature consistency and confidence-aware sample learning. This framework disentangles the whole feature representation of the target data into semantic-related feature and domain-related feature using dual classifiers to learn distinct feature representations. By maintaining consistency between the sub-features and the whole feature, the model can comprehensively capture data features from multiple perspectives. Additionally, to ensure that the whole feature information of the target domain samples is not overlooked, we set a adaptive threshold and calculate a confidence score for each sample to carry out loss weighted self-supervised learning, effectively reducing the noise of pseudo-labels and alleviating the problem of error accumulation. The efficacy of our proposed method is validated through extensive experimentation across various datasets, including CIFAR10-C, CIFAR100-C, and ImageNet-C, demonstrating consistent performance in continual test-time adaptation scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。