提出新方法提升开放集测试时自适应的稳定性和准确率。
Stabilizing Open-Set Test-Time Adaptation via Primary-Auxiliary Filtering and Knowledge-Integrated Prediction
- 用主辅过滤机制避免错误数据干扰模型更新
- 在多个数据集上同时提升封闭集准确率与开放集识别能力
- 适合需要应对真实场景分布偏移的模型部署应用
深度神经网络在训练与测试分布一致时表现优异,但现实测试数据常存在领域偏移。测试时自适应(TTA)通过推理时调整模型来应对这一问题。现有研究多假设训练与测试数据类别相同(封闭集TTA),但实际场景常为开放集TTA,导致封闭集性能下降。近期研究发现,在适应过程中识别开放集数据并最大化其熵值是有效方案,但该方法依赖源模型进行过滤,对领域偏移的测试数据过滤效果不佳。我们发现,从噪声测试流中学习领域知识的适应模型本身不稳定,用于过滤会累积错误。为此,我们提出主-辅过滤(PAF),利用辅助过滤器验证主过滤器的输出。同时提出知识融合预测(KIP),校准适应模型、EMA模型与源模型的输出,融合互补知识以实现开放集测试时自适应。我们在多种封闭集与开放集数据集上验证了该方法,结果表明其在保持或提升封闭集准确率的同时,显著增强开放集判别能力。代码已公开于https://github.com/powerpowe/PAF-KIP-OSTTA。
原文摘要 · Abstract (English)
Deep neural networks demonstrate strong performance under aligned training-test distributions. However, real-world test data often exhibit domain shifts. Test-Time Adaptation (TTA) addresses this challenge by adapting the model to test data during inference. While most TTA studies assume that the training and test data share the same class set (closed-set TTA), real-world scenarios often involve open-set data (open-set TTA), which can degrade closed-set accuracy. A recent study showed that identifying open-set data during adaptation and maximizing its entropy is an effective solution. However, the previous method relies on the source model for filtering, resulting in suboptimal filtering accuracy on domain-shifted test data. In contrast, we found that the adapting model, which learns domain knowledge from noisy test streams, tends to be unstable and leads to error accumulation when used for filtering. To address this problem, we propose Primary-Auxiliary Filtering (PAF), which employs an auxiliary filter to validate data filtered by the primary filter. Furthermore, we propose Knowledge-Integrated Prediction (KIP), which calibrates the outputs of the adapting model, EMA model, and source model to integrate their complementary knowledge for OSTTA. We validate our approach across diverse closed-set and open-set datasets. Our method enhances both closed-set accuracy and open-set discrimination over existing methods. The code is available at https://github.com/powerpowe/PAF-KIP-OSTTA .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。