arXiv:2511.03148cs.LGcs.CV2025-11

通过自适应分位数校准,实现无需重训练的测试时模型泛化增强。

Test Time Adaptation Using Adaptive Quantile Recalibration

  • 基于通道级分位数对齐,重塑激活分布以适配测试数据
  • 在多个图像数据集上显著提升模型在分布外情况下的准确率
  • 适用于多种归一化结构,适合资源受限的实时部署场景

领域自适应是提升深度学习模型在真实场景中泛化能力的关键策略,但传统方法通常依赖目标域先验知识或需重新训练模型,在动态或资源受限环境中实用性受限。近期基于批量归一化统计量更新的测试时自适应方法虽可实现无监督调整,但难以捕捉复杂激活分布,且仅限于特定归一化层。本文提出自适应分位数校准(AQR),通过通道级分位数对齐来修改预激活分布,能更完整地建模激活分布形状,并支持BatchNorm、GroupNorm和LayerNorm等多种架构。为应对不同批次大小下分布尾部估计的挑战,AQR引入稳健的尾部校准策略,提升稳定性与精度。该方法利用训练阶段计算的源域统计量,实现无需重训练的无监督自适应。在CIFAR-10-C、CIFAR-100-C和ImageNet-C等多个数据集上,跨多种模型架构的实验表明,AQR在多样环境下均表现出鲁棒的适应性能,优于现有测试时自适应基线。结果验证了其在动态、不可预测数据分布场景中的实际部署潜力。

原文摘要 · Abstract (English)

Domain adaptation is a key strategy for enhancing the generalizability of deep learning models in real-world scenarios, where test distributions often diverge significantly from the training domain. However, conventional approaches typically rely on prior knowledge of the target domain or require model retraining, limiting their practicality in dynamic or resource-constrained environments. Recent test-time adaptation methods based on batch normalization statistic updates allow for unsupervised adaptation, but they often fail to capture complex activation distributions and are constrained to specific normalization layers. We propose Adaptive Quantile Recalibration (AQR), a test-time adaptation technique that modifies pre-activation distributions by aligning quantiles on a channel-wise basis. AQR captures the full shape of activation distributions and generalizes across architectures employing BatchNorm, GroupNorm, or LayerNorm. To address the challenge of estimating distribution tails under varying batch sizes, AQR incorporates a robust tail calibration strategy that improves stability and precision. Our method leverages source-domain statistics computed at training time, enabling unsupervised adaptation without retraining models. Experiments on CIFAR-10-C, CIFAR-100-C, and ImageNet-C across multiple architectures demonstrate that AQR achieves robust adaptation across diverse settings, outperforming existing test-time adaptation baselines. These results highlight AQR's potential for deployment in real-world scenarios with dynamic and unpredictable data distributions.

测试时适应分布外泛化归一化改进

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。