针对测试时类别分布偏移,提出可自适应修正预测的增强方法
Label Distribution Shift-Aware Prediction Refinement for Test-Time Adaptation
- 通过分析类别混淆模式,构建测试时预测修正模块
- 在CIFAR-10C上实现5%-18%准确率提升,无分布偏移时无性能下降
- 可无缝集成至现有TTA方法,适合部署于分布不稳场景
测试时自适应(TTA)能缓解模型在测试阶段遭遇输入分布偏移时的性能下降。然而,现有方法在面对额外类别分布偏移时表现显著恶化。我们首先分析了不同协变量偏移下TTA方法中的类别混淆模式,并发现此类模式普遍存在。基于此,提出标签分布偏移感知的预测修正方法(DART),通过聚焦类别级混淆模式来优化预测。DART在中间阶段使用训练数据中多样化的批次训练一个预测修正模块,该模块在测试时用于检测并纠正类别分布偏移,显著提升了测试数据的伪标签准确性。在CIFAR-10C上,DART在存在标签分布偏移时取得5%-18%的准确率提升,且在无偏移情况下无性能损失。在CIFAR、PACS、OfficeHome和ImageNet等基准上的大量实验表明,DART能有效修正因测试时分布偏移导致的错误预测,从而提升现有TTA方法的性能,可作为即插即用的增强工具。
原文摘要 · Abstract (English)
Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops when facing additional class distribution shifts. We first analyze TTA methods under label distribution shifts and identify the presence of class-wise confusion patterns commonly observed across different covariate shifts. Based on this observation, we introduce label Distribution shift-Aware prediction Refinement for Test-time adaptation (DART), a novel TTA method that refines the predictions by focusing on class-wise confusion patterns. DART trains a prediction refinement module during an intermediate time by exposing it to several batches with diverse class distributions using the training dataset. This module is then used during test time to detect and correct class distribution shifts, significantly improving pseudo-label accuracy for test data. Our method exhibits 5-18% gains in accuracy under label distribution shifts on CIFAR-10C, without any performance degradation when there is no label distribution shift. Extensive experiments on CIFAR, PACS, OfficeHome, and ImageNet benchmarks demonstrate DART's ability to correct inaccurate predictions caused by test-time distribution shifts. This improvement leads to enhanced performance in existing TTA methods, making DART a valuable plug-in tool.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。