arXiv:2410.09398cs.LGcs.CV2024-10被引 2

MITA让模型与数据在测试时双向适配,提升复杂场景泛化能力

MITA: Bridging the Gap between Model and Data for Test-time Adaptation

  • 引入能量优化实现模型与数据双向自适应
  • 在异常值、混合分布等场景下超越现有最佳方法
  • 适合需要强泛化能力的现实应用部署

测试时自适应(TTA)已成为提升模型泛化能力的有前景范式。然而,现有主流TTA方法多在批量层面操作,在面对异常值或混合分布的复杂真实场景时表现不佳,原因在于过度依赖统计模式而忽视个体实例特征,导致模型分布与数据特性之间出现偏差。为此,我们提出基于中点相遇的测试时自适应(MITA),通过能量优化促使模型与数据从相反方向进行相互适应,从而在中间达成一致。MITA首次突破传统仅将模型对齐数据的思路,更有效地弥合了模型分布与数据特征之间的鸿沟。在三种不同场景(异常值、混合、纯)下的全面实验表明,MITA显著优于当前最优方法,展现出在实际应用中大幅提升泛化能力的巨大潜力。

原文摘要 · Abstract (English)

Test-Time Adaptation (TTA) has emerged as a promising paradigm for enhancing the generalizability of models. However, existing mainstream TTA methods, predominantly operating at batch level, often exhibit suboptimal performance in complex real-world scenarios, particularly when confronting outliers or mixed distributions. This phenomenon stems from a pronounced over-reliance on statistical patterns over the distinct characteristics of individual instances, resulting in a divergence between the distribution captured by the model and data characteristics. To address this challenge, we propose Meet-In-The-Middle based Test-Time Adaptation ($\textbf{MITA}$), which introduces energy-based optimization to encourage mutual adaptation of the model and data from opposing directions, thereby meeting in the middle. MITA pioneers a significant departure from traditional approaches that focus solely on aligning the model to the data, facilitating a more effective bridging of the gap between model's distribution and data characteristics. Comprehensive experiments with MITA across three distinct scenarios (Outlier, Mixture, and Pure) demonstrate its superior performance over SOTA methods, highlighting its potential to significantly enhance generalizability in practical applications.

测试时自适应模型泛化能量优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。