LATTA通过噪声扰动与权重锚点提升测试时自适应的稳定性和鲁棒性。
LATTA: Langevin-Anchored Test-Time Adaptation for Enhanced Robustness and Stability
- 引入随机梯度朗之万动力学思想,用噪声扰动探索参数空间。
- 在CIFAR-10-C上平均准确率提升超2%,性能方差显著降低。
- 无需模型结构调整或大量采样,适合资源受限场景部署。
测试时自适应(TTA)旨在仅使用无标签测试数据将预训练模型适配至分布偏移。尽管前景广阔,现有方法如Tent在小批次或严重干扰下易出现不稳定,甚至灾难性遗忘源知识。本文认为这源于复杂损失曲面上过于确定的更新。为此提出朗之万锚定测试时自适应(LATTA),通过两个关键机制实现正则化:(1)受随机梯度朗之万动力学(SGLD)启发的噪声权重扰动,以探索局部参数空间并逃离劣质局部极小值;(2)稳定的权重锚点,防止模型偏离鲁棒的源预训练状态。该组合使LATTA在不牺牲稳定性的情况下实现有效适应。不同于以往贝叶斯型TTA方法,LATTA无需架构变更或昂贵的蒙特卡洛推断。我们在标准基准(包括旋转MNIST和更具挑战性的CIFAR-10-C)上进行了广泛实验。结果表明,LATTA显著优于Tent、CoTTA和EATA等现有方法,在CIFAR-10-C上的平均准确率提升超过2%,同时大幅降低性能波动。
原文摘要 · Abstract (English)
Test-time adaptation (TTA) aims to adapt a pretrained model to distribution shifts using only unlabeled test data. While promising, existing methods like Tent suffer from instability and can catastrophically forget the source knowledge, especially with small batch sizes or challenging corruptions. We argue that this arises from overly deterministic updates on a complex loss surface. In this paper, we introduce Langevin-Anchored Test-Time Adaptation (LATTA), a novel approach that regularizes adaptation through two key mechanisms: (1) a noisy weight perturbation inspired by Stochastic Gradient Langevin Dynamics (SGLD) to explore the local parameter space and escape poor local minima, and (2) a stable weight anchor that prevents the model from diverging from its robust source pre-training. This combination allows LATTA to adapt effectively without sacrificing stability. Unlike prior Bayesian TTA methods, LATTA requires no architectural changes or expensive Monte Carlo passes. We conduct extensive experiments on standard benchmarks, including Rotated-MNIST and the more challenging CIFAR-10-C. Our results demonstrate that LATTA significantly outperforms existing methods, including Tent, CoTTA, and EATA, setting a new state of the art for self-supervised TTA by improving average accuracy on CIFAR-10-C by over 2% while simultaneously reducing performance variance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。