arXiv:2603.26096cs.LGcs.CV2026-03中稿 · CVPR

让激活函数动态调整,提升模型在分布偏移下的推理稳定性。

AcTTA: Rethinking Test-Time Adaptation via Dynamic Activation

  • 将激活函数重构成可学习形式,动态调节响应阈值与梯度敏感性。
  • 在CIFAR10-C、CIFAR100-C、ImageNet-C上均优于基于归一化的TTA方法。
  • 无需修改权重或源数据,适合部署在资源受限的实时推理场景。

测试时自适应(TTA)旨在通过推理阶段更新模型参数来缓解分布偏移导致的性能下降。现有方法主要聚焦于仿射调制,关注归一化层的重新校准。这一视角虽有效,却忽略了表示动态中另一关键组件——激活函数。本文重新审视该被忽视的领域,提出AcTTA,一种面向激活函数的自适应框架。AcTTA将传统激活函数(如ReLU、GELU)重构为可学习形式,动态调节其响应阈值并控制梯度敏感性,使网络能在域偏移下自适应调整激活行为。该函数重参数化实现无需修改网络权重或依赖源数据的连续激活调整。尽管结构简单,AcTTA在多种噪声类型下表现稳健,在CIFAR10-C、CIFAR100-C和ImageNet-C上持续超越基于归一化的TTA方法。结果表明,激活自适应是应对分布偏移的紧凑而高效路径,拓展了当前以仿射为中心的自适应范式。

原文摘要 · Abstract (English)

Test-time adaptation (TTA) aims to mitigate performance degradation under distribution shifts by updating model parameters during inference. Existing approaches have primarily framed adaptation around affine modulation, focusing on recalibrating normalization layers. This perspective, while effective, overlooks another influential component in representation dynamics: the activation function. We revisit this overlooked space and propose AcTTA, an activation-aware framework that reinterprets conventional activation functions from a learnable perspective and updates them adaptively at test time. AcTTA reformulates conventional activation functions (e.g., ReLU, GELU) into parameterized forms that shift their response threshold and modulate gradient sensitivity, enabling the network to adjust activation behavior under domain shifts. This functional reparameterization enables continuous adjustment of activation behavior without modifying network weights or requiring source data. Despite its simplicity, AcTTA achieves robust and stable adaptation across diverse corruptions. Across CIFAR10-C, CIFAR100-C, and ImageNet-C, AcTTA consistently surpasses normalization-based TTA methods. Our findings highlight activation adaptation as a compact and effective route toward domain-shift-robust test-time learning, broadening the prevailing affine-centric view of adaptation.

测试时自适应激活函数鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。