MoETTA用专家机制应对测试时混合分布偏移,提升模型鲁棒性。
MoETTA: Test-Time Adaptation Under Mixed Distribution Shifts with MoE-LayerNorm
- 引入基于熵的专家混合架构,允许不同样本走不同优化路径。
- 在三个混合分布场景中超越现有方法,最高提升6.2个百分点。
- 适合真实场景中复杂、多源分布偏移的模型部署与适应。
测试时自适应(TTA)在单一领域分布偏移下能有效缓解性能下降,但在真实场景中,测试样本常受多种异质且可能冲突的域因素影响,带来严峻挑战。现有方法依赖统一的自适应路径,无法捕捉不同域间最优梯度方向的差异。此外,现有基准仅涵盖合成或同质偏移,难以反映真实世界的异质混合偏移。为此,我们提出MoETTA,一种基于熵的新型TTA框架,融合混合专家(MoE)结构。不同于对所有样本施加同一参数更新规则,MoETTA引入一组结构解耦的专家,实现多样化梯度方向的自适应更新,从而更灵活地应对异质偏移。为模拟真实部署环境,我们构建两个新基准:potpourri和potpourri+。前者包含自然、艺术及对抗性失真等多样域偏移,后者还加入源域样本以评估灾难性遗忘鲁棒性。在三种混合分布偏移设置下的大量实验表明,MoETTA持续优于强基线,达到当前最优性能,验证了通过专家级多样性建模多重自适应方向的有效性。
原文摘要 · Abstract (English)
Test-Time adaptation (TTA) has proven effective in mitigating performance drops under single-domain distribution shifts by updating model parameters during inference. However, real-world deployments often involve mixed distribution shifts, where test samples are affected by diverse and potentially conflicting domain factors, posing significant challenges even for SOTA TTA methods. A key limitation in existing approaches is their reliance on a unified adaptation path, which fails to account for the fact that optimal gradient directions can vary significantly across different domains. Moreover, current benchmarks focus only on synthetic or homogeneous shifts, failing to capture the complexity of real-world heterogeneous mixed distribution shifts. To address this, we propose MoETTA, a novel entropy-based TTA framework that integrates the Mixture-of-Experts (MoE) architecture. Rather than enforcing a single parameter update rule for all test samples, MoETTA introduces a set of structurally decoupled experts, enabling adaptation along diverse gradient directions. This design allows the model to better accommodate heterogeneous shifts through flexible and disentangled parameter updates. To simulate realistic deployment conditions, we introduce two new benchmarks: potpourri and potpourri+. While classical settings focus solely on synthetic corruptions, potpourri encompasses a broader range of domain shifts--including natural, artistic, and adversarial distortions--capturing more realistic deployment challenges. Additionally, potpourri+ further includes source-domain samples to evaluate robustness against catastrophic forgetting. Extensive experiments across three mixed distribution shifts settings show that MoETTA consistently outperforms strong baselines, establishing SOTA performance and highlighting the benefit of modeling multiple adaptation directions via expert-level diversity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。