提出首个结合持续学习的弱监督视频异常检测方法,解决数据域变化下的模型遗忘问题。
CADE: Continual Weakly-supervised Video Anomaly Detection with Ensembles
- 用双生成器缓解弱监督下的数据不平衡与标签不确定性
- 多判别器集成有效捕捉因遗忘遗漏的历史异常模式
- 在ShanghaiTech和Charlotte数据集上显著优于现有方法
视频异常检测(VAD)在公共安全与犯罪预防中具有重要意义。近年来,由于标注简便且效果良好,弱监督视频异常检测(WVAD)受到广泛关注。然而,现有方法主要针对静态数据集,忽视了数据域随时间变化的可能性。为应对这一挑战,需引入持续学习(CL)机制,否则仅用新数据训练会导致旧数据性能下降(即遗忘)。为此,我们提出首个融合持续学习与弱监督检测的框架——连续异常检测集成方法(CADE)。CADE采用双生成器(DG)缓解弱监督中的数据不平衡与标签不确定性;同时发现,遗忘会加剧模型对特定异常模式的偏倚,导致漏检。为此,我们设计多判别器集成(MD),通过多个历史模型捕捉被遗忘的异常。大量实验表明,CADE在ShanghaiTech和Charlotte Anomaly等多场景数据集上显著优于现有VAD方法。
原文摘要 · Abstract (English)
Video anomaly detection (VAD) has long been studied as a crucial problem in public security and crime prevention. In recent years, weakly-supervised VAD (WVAD) have attracted considerable attention due to their easy annotation process and promising research results. While existing WVAD methods tackle mainly on static datasets, the possibility that the domain of data can vary has been neglected. To adapt such domain-shift, the continual learning (CL) perspective is required because otherwise additional training only with new coming data could easily cause performance degradation for previous data, i.e., forgetting. Therefore, we propose a brand-new approach, called Continual Anomaly Detection with Ensembles (CADE) that is the first work combining CL and WVAD viewpoints. Specifically, CADE uses the Dual-Generator(DG) to address data imbalance and label uncertainty in WVAD. We also found that forgetting exacerbates the "incompleteness'' where the model becomes biased towards certain anomaly modes, leading to missed detections of various anomalies. To address this, we propose to ensemble Multi-Discriminator (MD) that capture missed anomalies in past scenes due to forgetting, using multiple models. Extensive experiments show that CADE significantly outperforms existing VAD methods on the common multi-scene VAD datasets, such as ShanghaiTech and Charlotte Anomaly datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。