arXiv:2510.12150cs.CV2025-10NeurIPS被引 2

提出KFF方法,让模型在测试时持续适应新领域,兼顾旧知识保留与新知识学习。

Class-aware Domain Knowledge Fusion and Fission for Continual Test-Time Adaptation

  • 按类别融合与分离领域知识,动态积累有效历史信息。
  • 在ImageNet-C上相比基线提升5.2%准确率,显著缓解遗忘与干扰。
  • 适合需要长期部署、持续适应新场景的视觉系统开发者。

持续测试时自适应(CTTA)旨在测试阶段快速微调模型,以适应多个未知下游领域分布,而无需预先获取下游领域数据。现有先进方法通常通过恢复初始模型或重用历史模型来减轻因下游领域数据不规则切换导致的历史知识灾难性遗忘。然而,这些方法常伴随新知识学习不足和潜在有害历史知识干扰,导致性能严重下降。为此,本文提出类感知领域知识融合与分裂方法(KFF),根据测试时来自不同领域的数据,自适应地扩展并合并旧域与新域的类感知领域知识,使判别性历史知识得以动态累积。针对流式数据中存在的巨大领域差异,设计领域知识分裂(KFI)模块,从配对的类感知领域提示池中自适应分离新领域知识,缓解由与当前领域差异大的旧领域带来的负向知识影响。同时,为避免持续分裂新知识带来的累积计算与存储开销,进一步设计领域知识融合(KFU)模块,以最小成本将分裂后的知识合并至现有知识池,采用贪婪的知识动态融合策略,在保持计算效率的同时提升新旧知识兼容性。在ImageNet-C数据集上的大量实验验证了所提方法的有效性,显著优于其他方法。

原文摘要 · Abstract (English)

Continual Test-Time Adaptation (CTTA) aims to quickly fine-tune the model during the test phase so that it can adapt to multiple unknown downstream domain distributions without pre-acquiring downstream domain data. To this end, existing advanced CTTA methods mainly reduce the catastrophic forgetting of historical knowledge caused by irregular switching of downstream domain data by restoring the initial model or reusing historical models. However, these methods are usually accompanied by serious insufficient learning of new knowledge and interference from potentially harmful historical knowledge, resulting in severe performance degradation. To this end, we propose a class-aware domain Knowledge Fusion and Fission method for continual test-time adaptation, called KFF, which adaptively expands and merges class-aware domain knowledge in old and new domains according to the test-time data from different domains, where discriminative historical knowledge can be dynamically accumulated. Specifically, considering the huge domain gap within streaming data, a domain Knowledge FIssion (KFI) module is designed to adaptively separate new domain knowledge from a paired class-aware domain prompt pool, alleviating the impact of negative knowledge brought by old domains that are distinct from the current domain. Besides, to avoid the cumulative computation and storage overheads from continuously fissioning new knowledge, a domain Knowledge FUsion (KFU) module is further designed to merge the fissioned new knowledge into the existing knowledge pool with minimal cost, where a greedy knowledge dynamic merging strategy is designed to improve the compatibility of new and old knowledge while keeping the computational efficiency. Extensive experiments on the ImageNet-C dataset verify the effectiveness of our proposed method against other methods.

持续学习测试时适应知识融合图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。