arXiv:2411.03687cs.LGcs.AI2024-11综述被引 68

测试时自适应让模型在推理阶段动态调整,应对分布偏移问题。

Beyond Model Adaptation at Test Time: A Survey

  • 按模型、推理、归一化等五个组件分类,系统梳理测试时自适应方法
  • 涵盖400多篇论文,覆盖视觉、视频、3D及多模态领域应用
  • 适合关注模型鲁棒性与真实场景部署的研究者和工程师

机器学习算法在诸多领域取得显著成功,但普遍假设训练与测试数据来自相同分布。一旦测试分布发生偏移,模型性能便急剧下降。域适应与域泛化虽被广泛研究,但各有局限。测试时自适应作为新兴范式,仅用源域数据训练,在测试推理阶段动态适应目标域,融合了两者优势。本文综述超过400篇相关论文,将现有方法按可调整组件分为五类:模型、推理、归一化、样本与提示,并深入分析各类方法的准备与适应设置。进一步探讨其在图像、视频、3D及多模态领域的实际应用,揭示应对分布偏移的有效策略,并展望未来研究方向。

原文摘要 · Abstract (English)

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these algorithms struggle and become brittle even when samples in the test distribution start to deviate from the ones observed during training. Domain adaptation and domain generalization have been studied extensively as approaches to address distribution shifts across test and train domains, but each has its limitations. Test-time adaptation, a recently emerging learning paradigm, combines the benefits of domain adaptation and domain generalization by training models only on source data and adapting them to target data during test-time inference. In this survey, we provide a comprehensive and systematic review on test-time adaptation, covering more than 400 recent papers. We structure our review by categorizing existing methods into five distinct categories based on what component of the method is adjusted for test-time adaptation: the model, the inference, the normalization, the sample, or the prompt, providing detailed analysis of each. We further discuss the various preparation and adaptation settings for methods within these categories, offering deeper insights into the effective deployment for the evaluation of distribution shifts and their real-world application in understanding images, video and 3D, as well as modalities beyond vision. We close the survey with an outlook on emerging research opportunities for test-time adaptation.

测试时自适应分布偏移模型鲁棒性综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。