arXiv:2605.17743cs.CV2026-05

让模型在动态环境中持续学习,避免记忆丢失和错误累积。

MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptation

论文配图:MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptation
图 1 · 摘自论文原文
  • 用激活稀疏专家分离图像结构与纹理,分路处理提升适应能力。
  • 在多个数据集上实现当前最优性能,有效缓解灾难性遗忘。
  • 适合需要长期稳定推理的视觉系统,如自动驾驶感知场景。

持续测试时适应需在无标签目标流中持续调整预训练模型,同时保留已有知识,但纹理偏差的骨干网络易导致错误积累与灾难性遗忘。受人类视觉系统解耦形状与纹理机制启发,我们提出MoASE,一种即插即用的专家混合模型,通过激活稀疏专家与空间可微分丢弃,将领域无关结构与领域特定纹理分离,形成高/低激活路径;高/低秩瓶颈进一步丰富表示。激活稀疏门根据输入自适应生成SDD阈值,精准选择关键令牌;领域感知路由器利用纹理敏感线索为每个样本分配专家权重。为抑制无标签流上的确认偏差并稳定监督,我们引入领域自适应在线策略蒸馏构建MoASE++:采用EMA锚定的在线反KL蒸馏,并设计基于熵与置信度的增强策略,使同一视图预测对齐,提升鲁棒性与可塑性平衡。在分类(CIFAR-10/100-C、ImageNet-C)与语义分割(Cityscapes→ACDC)任务上广泛实验表明,该方法始终达到当前最优表现,为动态视觉环境中的持续适应提供了原理清晰、可控的解决方案。

原文摘要 · Abstract (English)

Continual test-time adaptation adapts a source-pretrained model to non-stationary, unlabeled target streams while retaining past competence, yet texture-biased backbones risk error accumulation and catastrophic forgetting. Drawing inspiration from the process of decoupling shape and texture in the human visual system, we introduce MoASE, a plug-in mixture-of-experts that disentangles domain-agnostic structure from domain-specific texture using Activation Sparsity Experts with Spatial Differentiable Dropout, forming complementary high- and low-activation pathways, while high- and low-rank bottlenecks diversify representations. The Activation Sparsity Gate produces input-adaptive SDD thresholds for precise token selection, and the Domain-Aware Router assigns per-sample expert weights using texture-sensitive cues. To curb confirmation bias on unlabeled streams and stabilize supervision, we then introduce Domain-Adaptive On-Policy Distillation to constitute MoASE++, with an EMA-anchored on-policy reverse KL distillation and an augmentation policy conditioned on entropy and confidence that aligns predictions across the same views and improves the robustness-plasticity balance. Extensive experiments on classification (CIFAR-10/100-C, ImageNet-C) and semantic segmentation (Cityscapes->ACDC) demonstrate consistent state-of-the-art performance, offering a principled, controllable approach to continual adaptation in dynamic visual environments.

持续学习测试时适应专家混合视觉系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。