用最小化隐变量熵提升异常检测,无需标签也能精准识别异常视频帧。
MLE-UVAD: Minimal Latent Entropy Autoencoder for Fully Unsupervised Video Anomaly Detection
- 通过重建损失与最小隐变量熵损失双驱动,让正常帧聚类而异常帧被拉入正常分布。
- 在两个基准数据集和自建驾驶数据集上均超越现有方法,异常检测准确率显著提升。
- 适合无标签场景下的视频异常检测,尤其适用于真实世界中难以获取标注的场景。
本文针对单场景完全无监督视频异常检测(VAD)问题,直接使用包含正常与异常事件的原始视频进行训练与测试,无需任何标注。与以往依赖大量标注或仅用正常视频的方法不同,该方法避免了分布偏移和污染问题。提出一种基于熵引导的自编码器,通过重建误差检测异常:正常帧能被良好重建,而异常帧重建效果差。核心思想是将标准重建损失与新颖的最小隐变量熵(MLE)损失结合。重建损失使正常与异常输入在潜在空间形成分离簇,但可能导致异常被过度重建;而MLE损失通过最小化潜在嵌入熵,促使嵌入集中于高密度区域。由于正常帧占主导,稀疏的异常嵌入被拉入正常簇,解码器因此更关注正常模式,对异常帧产生较差重建。这种双损失设计形成了明显的重建差异,实现有效异常检测。在两个主流基准数据集及一个具有挑战性的自建驾驶数据集上的大量实验表明,本方法性能稳健且优于基线。
原文摘要 · Abstract (English)
In this paper, we address the challenging problem of single-scene, fully unsupervised video anomaly detection (VAD), where raw videos containing both normal and abnormal events are used directly for training and testing without any labels. This differs sharply from prior work that either requires extensive labeling (fully or weakly supervised) or depends on normal-only videos (one-class classification), which are vulnerable to distribution shifts and contamination. We propose an entropy-guided autoencoder that detects anomalies through reconstruction error by reconstructing normal frames well while making anomalies reconstruct poorly. The key idea is to combine the standard reconstruction loss with a novel Minimal Latent Entropy (MLE) loss in the autoencoder. Reconstruction loss alone maps normal and abnormal inputs to distinct latent clusters due to their inherent differences, but also risks reconstructing anomalies too well to detect. Therefore, MLE loss addresses this by minimizing the entropy of latent embeddings, encouraging them to concentrate around high-density regions. Since normal frames dominate the raw video, sparse anomalous embeddings are pulled into the normal cluster, so the decoder emphasizes normal patterns and produces poor reconstructions for anomalies. This dual-loss design produces a clear reconstruction gap that enables effective anomaly detection. Extensive experiments on two widely used benchmarks and a challenging self-collected driving dataset demonstrate that our method achieves robust and superior performance over baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。