arXiv:2506.19022cs.CV2025-06被引 1

提出OoPk方法,实现持续测试时自适应中的高效知识保留与更新。

Orthogonal Projection Subspace to Aggregate Online Prior-knowledge for Continual Test-time Adaptation

  • 通过正交投影保持预训练模型知识完整,防止灾难性遗忘。
  • 利用图像遮蔽模拟目标动态,在线聚合先验知识提升适应能力。
  • 适用于复杂语义分割任务,显著降低误差累积,适合持续学习场景。

持续测试时自适应(CTTA)要求预训练模型在目标分布变化的场景中持续适应。现有方法主要关注缓解灾难性遗忘和误差累积问题,尽管已有基于参数高效微调的遗忘适应方法,但在复杂任务如语义分割中仍难以平衡性能与适应效率。本文提出一种新框架OoPk:首先将微调子空间正交投影,确保模型在适应新领域的同时保持源模型知识完整性;其次设计一种在线先验知识聚合策略,采用激进而高效的图像遮蔽机制模拟潜在的目标动态,增强学生模型的域适应能力,并逐步优化教师模型知识,保障高质量伪标签生成,减少误差累积。大量实验表明,该方法在多个连续TTA基准上超越现有方法,达到领先性能。

原文摘要 · Abstract (English)

Continual Test Time Adaptation (CTTA) is a task that requires a source pre-trained model to continually adapt to new scenarios with changing target distributions. Existing CTTA methods primarily focus on mitigating the challenges of catastrophic forgetting and error accumulation. Though there have been emerging methods based on forgetting adaptation with parameter-efficient fine-tuning, they still struggle to balance competitive performance and efficient model adaptation, particularly in complex tasks like semantic segmentation. In this paper, to tackle the above issues, we propose a novel pipeline, Orthogonal Projection Subspace to aggregate online Prior-knowledge, dubbed OoPk. Specifically, we first project a tuning subspace orthogonally which allows the model to adapt to new domains while preserving the knowledge integrity of the pre-trained source model to alleviate catastrophic forgetting. Then, we elaborate an online prior-knowledge aggregation strategy that employs an aggressive yet efficient image masking strategy to mimic potential target dynamism, enhancing the student model's domain adaptability. This further gradually ameliorates the teacher model's knowledge, ensuring high-quality pseudo labels and reducing error accumulation. We demonstrate our method with extensive experiments that surpass previous CTTA methods and achieve competitive performances across various continual TTA benchmarks in semantic segmentation tasks.

持续学习测试时适应语义分割知识保留

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。