用模糊图像训练,让模型专注运动差异,零样本跨数据集检测异常
Appearance Blur-driven AutoEncoder and Motion-guided Memory Module for Video Anomaly Detection
- 通过高斯模糊构造伪异常,引导网络学习正常模式
- 利用多尺度注意力恢复正常图像,增强异常判别力
- 基于运动记忆实现零样本跨域检测,适合新场景快速部署
视频异常检测(VAD)通常学习正常样本分布,通过测量显著偏差来识别异常,但过度泛化可能导致部分异常被重建,从而抑制偏差。同时,多数VAD方法无法在新目标域上进行零样本跨数据集验证,少样本方法需在目标域上繁琐微调以完成域适应。为此,我们提出一种新型VAD方法,引入运动引导记忆模块,实现无需适配的零样本跨数据集验证。首先,在原始外观图像上添加高斯模糊,构建全局伪异常作为网络输入;其次,采用多尺度残差通道注意力机制对正常样本的伪异常进行去模糊;再次,在训练阶段记录运动特征作为记忆项,测试阶段通过原始信息检索对应运动特征;最后,模型通过注意力机制忽略真实模糊异常,依赖运动记忆项放大正常与异常运动之间的差异。在三个基准数据集上的大量实验表明,该方法在无需测试时适配的情况下,性能优于现有跨域方法。
原文摘要 · Abstract (English)
Video anomaly detection (VAD) often learns the distribution of normal samples and detects the anomaly through measuring significant deviations, but the undesired generalization may reconstruct a few anomalies thus suppressing the deviations. Meanwhile, most VADs cannot cope with cross-dataset validation for new target domains, and few-shot methods must laboriously rely on model-tuning from the target domain to complete domain adaptation. To address these problems, we propose a novel VAD method with a motion-guided memory module to achieve cross-dataset validation with zero-shot. First, we add Gaussian blur to the raw appearance images, thereby constructing the global pseudo-anomaly, which serves as the input to the network. Then, we propose multi-scale residual channel attention to deblur the pseudo-anomaly in normal samples. Next, memory items are obtained by recording the motion features in the training phase, which are used to retrieve the motion features from the raw information in the testing phase. Lastly, our method can ignore the blurred real anomaly through attention and rely on motion memory items to increase the normality gap between normal and abnormal motion. Extensive experiments on three benchmark datasets demonstrate the effectiveness of the proposed method. Compared with cross-domain methods, our method achieves competitive performance without adaptation during testing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。