提出动态对比学习,让模型在未知场景中更鲁棒地适应新数据。
Open-World Test-Time Training: Self-Training with Contrast Learning
- 用对比学习动态增强正样本对,提升早期特征质量
- 在CIFAR-10-C、ImageNet-C等数据集上性能领先
- 适合部署于开放世界、存在大量异常数据的实境场景
传统测试时训练(TTT)方法虽能应对领域偏移,但通常假设类别集合恒定,难以适用于真实世界中无限多样的情况。开放世界测试时训练(OWTTT)旨在让深度学习模型泛化到未知目标分布,尤其在强分布外(OOD)数据存在时仍保持性能。现有方法在面对强OOD数据时表现不佳,且多聚焦于区分强弱OOD数据。然而,在TTT初期,强OOD数据与噪声干扰导致特征提取受阻,对比度下降,部分类别被误判为强OOD。为此,本文提出开放世界动态对比学习(OWDCL),通过对比学习扩充正样本对,不仅增强了初期对比度,还显著提升了后续阶段的模型鲁棒性。在多个基准数据集上的实验表明,该方法实现了最先进的性能。
原文摘要 · Abstract (English)
Traditional test-time training (TTT) methods, while addressing domain shifts, often assume a consistent class set, limiting their applicability in real-world scenarios characterized by infinite variety. Open-World Test-Time Training (OWTTT) addresses the challenge of generalizing deep learning models to unknown target domain distributions, especially in the presence of strong Out-of-Distribution (OOD) data. Existing TTT methods often struggle to maintain performance when confronted with strong OOD data. In OWTTT, the focus has predominantly been on distinguishing between overall strong and weak OOD data. However, during the early stages of TTT, initial feature extraction is hampered by interference from strong OOD and corruptions, resulting in diminished contrast and premature classification of certain classes as strong OOD. To address this, we introduce Open World Dynamic Contrastive Learning (OWDCL), an innovative approach that utilizes contrastive learning to augment positive sample pairs. This strategy not only bolsters contrast in the early stages but also significantly enhances model robustness in subsequent stages. In comparison datasets, our OWDCL model has produced the most advanced performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。