arXiv:2601.14069cs.CVcs.AI2026-01

无监督视频增量学习新方法,避免遗忘且无需标签

Unsupervised Video Class-Incremental Learning via Deep Embedded Clustering Management

  • 用深度聚类逐步构建视频特征簇,实现无标签增量学习
  • 在UCF101等3个数据集上性能超越已有方法
  • 适合缺乏标注数据的持续学习场景

无监督视频类别增量学习(uVCIL)是一种无需标签即可持续学习视频信息且不遗忘旧知识的重要范式。以往方法多依赖有监督学习,需标签和任务边界知识,成本高且不现实。本文提出一种简单有效的方法:先通过深度特征提取器获取各阶段视频特征,不假设类别或任务信息;再逐步基于特征构建深层聚类。后续任务学习时,以先前任务的模型作为初始化状态,实现知识迁移。在UCF101、HMDB51和Something-to-Something V2三个标准视频动作识别数据集上,忽略监督标签进行评估,所提方法在所有数据集上均显著优于基线模型。

原文摘要 · Abstract (English)

Unsupervised video class incremental learning (uVCIL) represents an important learning paradigm for learning video information without forgetting, and without considering any data labels. Prior approaches have focused on supervised class-incremental learning, relying on using the knowledge of labels and task boundaries, which is costly, requires human annotation, or is simply not a realistic option. In this paper, we propose a simple yet effective approach to address the uVCIL. We first consider a deep feature extractor network, providing a set of representative video features during each task without assuming any class or task information. We then progressively build a series of deep clusters from the extracted features. During the successive task learning, the model updated from the previous task is used as an initial state in order to transfer knowledge to the current learning task. We perform in-depth evaluations on three standard video action recognition datasets, including UCF101, HMDB51, and Something-to-Something V2, by ignoring the labels from the supervised setting. Our approach significantly outperforms other baselines on all datasets.

无监督学习视频理解增量学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。