arXiv:2602.11743cs.CV2026-02中稿 · ICLR被引 2

用自适应的泰利斯熵改进视觉-语言模型测试时适应,更准确地处理数据偏见。

Adaptive Debiasing Tsallis Entropy for Test-Time Adaptation

  • 引入可调参数q的泰利斯熵,动态校正类别偏见。
  • 在10个跨域基准上平均性能领先,不依赖特定模型或提示。
  • 无需调参即可替代传统熵方法,适合实际部署场景。

主流测试时适应(TTA)方法通常依赖香农熵(SE)衡量视觉-语言模型(如CLIP)在测试阶段的预测不确定性与不一致性。然而,由于预训练数据高度不平衡,CLIP存在固有偏见,导致SE产生偏差的不确定性估计。我们发现并证明,广义形式的泰利斯熵(TE)通过引入非可加参数q,天然适用于刻画偏见分布,且香农熵性能为其下界。基于此,我们提出自适应去偏泰利斯熵(ADTE),通过归一化持续输入测试样本的标签偏见,为每类定制专属参数q^l。该自适应机制能精准筛选高置信度视图,并无缝结合标签调整策略提升适应效果,无需分布特定超参数调优。实验表明,无论模型架构或文本提示如何,ADTE在ImageNet及其五个变体上均超越现有最优方法,在10个跨域基准上实现最高平均性能。代码已开源。

原文摘要 · Abstract (English)

Mainstream Test-Time Adaptation (TTA) methods for adapting vision-language models, e.g., CLIP, typically rely on Shannon Entropy (SE) at test time to measure prediction uncertainty and inconsistency. However, since CLIP has a built-in bias from pretraining on highly imbalanced web-crawled data, SE inevitably results in producing biased estimates of uncertainty entropy. To address this issue, we notably find and demonstrate that Tsallis Entropy (TE), a generalized form of SE, is naturally suited for characterizing biased distributions by introducing a non-extensive parameter q, with the performance of SE serving as a lower bound for TE. Building upon this, we generalize TE into Adaptive Debiasing Tsallis Entropy (ADTE) for TTA, customizing a class-specific parameter q^l derived by normalizing the estimated label bias from continuously incoming test instances, for each category. This adaptive approach allows ADTE to accurately select high-confidence views and seamlessly integrate with a label adjustment strategy to enhance adaptation, without introducing distribution-specific hyperparameter tuning. Besides, our investigation reveals that both TE and ADTE can serve as direct, advanced alternatives to SE in TTA, without any other modifications. Experimental results show that ADTE outperforms state-of-the-art methods on ImageNet and its five variants, and achieves the highest average performance on 10 cross-domain benchmarks, regardless of the model architecture or text prompts used. Our code is available at https://github.com/Jinx630/ADTE.

测试时适应泰利斯熵去偏视觉-语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。