arXiv:2505.20704cs.CV2025-05ICML被引 10

提出新方法提升极端数据稀缺下的模型自适应能力

Beyond Entropy: Region Confidence Proxy for Wild Test-Time Adaptation

  • 用区域置信度替代传统熵值优化
  • 在多个数据集上显著优于现有方法
  • 适合应对真实场景中多类分布偏移

野生测试时自适应(WTTA)旨在极端数据稀缺和多重分布偏移下,将源模型适配到未见目标域。现有方法主要聚焦于样本选择策略,却忽视了底层优化问题。本文批判性分析了WTTA中广泛采用的熵最小化框架,发现其在噪声优化动态下存在显著局限,严重阻碍适应效率。通过分析,我们识别出区域置信度是比传统熵更优的替代指标,但直接优化计算开销过大,难以实时应用。为此,本文提出新型区域集成方法ReCAP:首先设计概率区域建模方案,灵活捕捉嵌入空间中的语义变化;随后构建有限到无限的渐近近似,将不可行的区域置信度转化为可计算且上界可控的代理量。该方法在多个数据集和真实复杂场景中均表现出一致优势,显著释放局部区域潜在优化动力。

原文摘要 · Abstract (English)

Wild Test-Time Adaptation (WTTA) is proposed to adapt a source model to unseen domains under extreme data scarcity and multiple shifts. Previous approaches mainly focused on sample selection strategies, while overlooking the fundamental problem on underlying optimization. Initially, we critically analyze the widely-adopted entropy minimization framework in WTTA and uncover its significant limitations in noisy optimization dynamics that substantially hinder adaptation efficiency. Through our analysis, we identify region confidence as a superior alternative to traditional entropy, however, its direct optimization remains computationally prohibitive for real-time applications. In this paper, we introduce a novel region-integrated method ReCAP that bypasses the lengthy process. Specifically, we propose a probabilistic region modeling scheme that flexibly captures semantic changes in embedding space. Subsequently, we develop a finite-to-infinite asymptotic approximation that transforms the intractable region confidence into a tractable and upper-bounded proxy. These innovations significantly unlock the overlooked potential dynamics in local region in a concise solution. Our extensive experiments demonstrate the consistent superiority of ReCAP over existing methods across various datasets and wild scenarios.

自适应分布外无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。