arXiv:2501.07236cs.CV2025-01被引 9

提出无样本视频增量学习新框架,解决时空信息遗忘问题

CSTA: Spatial-Temporal Causal Adaptive Learning for Exemplar-Free Video Class-Incremental Learning

  • 用独立时空适配器学习新类别特征
  • 引入因果蒸馏与补偿机制,提升表示效率4.2%准确率
  • 适合视频持续学习场景,无需存储旧样本

持续学习旨在获取新知识的同时保留旧信息。类别增量学习(CIL)面临类别顺序引入的挑战。对于视频数据,需同时学习和保留空间外观与时间动作特征,比图像更复杂。为此,我们提出一种无样本框架,为每个类别配备独立的时空适配器,以适应其独特的增量表示需求。尽管独立适配器可缓解遗忘并满足个性化需求,但盲目使用会破坏空间与时间信息间的内在关联,影响新类别的表征效率。受此启发,我们从因果视角提出两项创新:首先,设计因果蒸馏模块,保持时空知识间的关系,实现更高效表示;其次,提出因果补偿机制,减少增量与记忆过程中不同类型信息间的冲突。在基准数据集上的大量实验表明,该框架达到新的最先进水平,平均准确率超越当前基于样本的方法4.2%。

原文摘要 · Abstract (English)

Continual learning aims to acquire new knowledge while retaining past information. Class-incremental learning (CIL) presents a challenging scenario where classes are introduced sequentially. For video data, the task becomes more complex than image data because it requires learning and preserving both spatial appearance and temporal action involvement. To address this challenge, we propose a novel exemplar-free framework that equips separate spatiotemporal adapters to learn new class patterns, accommodating the incremental information representation requirements unique to each class. While separate adapters are proven to mitigate forgetting and fit unique requirements, naively applying them hinders the intrinsic connection between spatial and temporal information increments, affecting the efficiency of representing newly learned class information. Motivated by this, we introduce two key innovations from a causal perspective. First, a causal distillation module is devised to maintain the relation between spatial-temporal knowledge for a more efficient representation. Second, a causal compensation mechanism is proposed to reduce the conflicts during increment and memorization between different types of information. Extensive experiments conducted on benchmark datasets demonstrate that our framework can achieve new state-of-the-art results, surpassing current example-based methods by 4.2% in accuracy on average.

视频增量学习因果学习持续学习无样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。