不训练也不标注,用更清晰的正常样本描述提升异常检测效果
NOVA: Normal-Side Modeling for Training-Free Zero-Shot Video Anomaly Detection

- 用排除易混淆动词的提示词增强正常语义表达
- 通过视频首帧构建加权视觉正常锚点,对齐文本与图像特征
- 在多个数据集上达到当前最优零样本性能,适合无标注场景
无训练零样本视频异常检测(ZS-VAD)利用视觉语言模型(VLMs)从预定义异常词汇中定位异常实例,无需提供任何视频样本。现有基于CLIP的方法多关注异常语义,而对正常性建模不足。我们发现两个关键问题:(i) 决策边界模糊——正常提示词可能包含与异常语义相近的动词(如running),导致正常与异常在VLM嵌入空间中区分度下降;(ii) 模态差距——文本正常锚点与视觉帧特征对齐不佳。本文提出NOVA,一种无训练的零样本视频异常检测框架,从语言和视觉两方面强化正常侧建模。NOVA引入正常感知提示构造(NA),排除邻近异常的动词,使正常描述偏向静态、低运动场景。为克服文本-视觉模态差异,提出视觉正常锚点(VNA),基于测试视频首帧构建加权视觉正常锚点,提供无需任务训练或标注的视频特定正常参考。NOVA在UCF-Crime上达到89.86% AUC,在XD-Violence上实现95.07% AUC和84.82% AP,优于同类无训练零样本方法。
原文摘要 · Abstract (English)
Training-free zero-shot video anomaly detection (ZS-VAD) leverages vision-language models (VLMs) to localize anomaly instances from a predefined anomaly vocabulary, without providing any video. Existing CLIP-based methods often emphasize anomaly-side semantics, while the competing normality side remains less carefully formulated. We identify two key limitations in existing solutions: (i) blurred decision boundary: normal prompts may contain ambiguous verbs, such as running, that are semantically close to anomalies, reducing normal and abnormal separation in the VLM embedding space; and (ii) modality gap: poor alignment between features of textual normal anchors and visual frames. We propose NOVA, a training-free ZS-VAD framework that strengthens the normal side at both linguistic and visual levels. NOVA introduces Normality-Aware Prompt Construction (NA), which excludes anomaly-adjacent verbs and biases normal descriptions toward static, low-motion scenes. To overcome the text-vision modality gap, NOVA constructs a Visual Normality Anchor (VNA), which creates a weighted visual normal anchor from the initial frames of each test video, providing a video-specific normal reference without task-specific training or annotations. NOVA achieves 89.86 percent AUC on UCF-Crime and 95.07 percent AUC and 84.82 percent AP on XD-Violence, reaching state-of-the-art performance among comparable training-free zero-shot methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。