arXiv:2411.17869cs.CVcs.LG2024-11被引 6

通过对比重构提升模型在新数据域的适应能力。

ReC-TTT: Contrastive Feature Reconstruction for Test-Time Training

  • 利用交叉重构设计双编码器+共享解码器结构
  • 测试时通过重构损失优化编码器特征提取
  • 适合应对真实场景中数据分布变化的任务

深度学习在计算机视觉任务中取得显著进展,但对数据分布实时变化的适应仍具挑战。测试时训练(TTT)通过在训练阶段引入辅助任务,并在测试时使用其损失来动态调整模型,从而提升泛化能力。受对比表征学习启发,本文提出ReC-TTT,一种通过生成输入数据的判别性视图实现模型对未见数据域自适应的测试时训练方法。ReC-TTT采用冻结编码器与两个可训练编码器之间的交叉重建作为辅助任务,共享一个解码器。在测试阶段,解码器固定于源域,通过重构损失引导编码器学习可被正确重建的特征。实验表明,ReC-TTT在多数领域偏移分类任务中优于现有最先进方法。

原文摘要 · Abstract (English)

The remarkable progress in deep learning (DL) showcases outstanding results in various computer vision tasks. However, adaptation to real-time variations in data distributions remains an important challenge. Test-Time Training (TTT) was proposed as an effective solution to this issue, which increases the generalization ability of trained models by adding an auxiliary task at train time and then using its loss at test time to adapt the model. Inspired by the recent achievements of contrastive representation learning in unsupervised tasks, we propose ReC-TTT, a test-time training technique that can adapt a DL model to new unseen domains by generating discriminative views of the input data. ReC-TTT uses cross-reconstruction as an auxiliary task between a frozen encoder and two trainable encoders, taking advantage of a single shared decoder. This enables, at test time, to adapt the encoders to extract features that will be correctly reconstructed by the decoder that, in this phase, is frozen on the source domain. Experimental results show that ReC-TTT achieves better results than other state-of-the-art techniques in most domain shift classification challenges.

测试时训练对比学习域适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。