arXiv:2504.13092cs.CV2025-04中稿 · ACM MM 2025被引 48

无需训练,通过事件感知机制提升视频异常检测精度

EventVAD: Training-Free Event-Aware Video Anomaly Detection

  • 构建动态图模型捕捉事件级视频特征,结合时间衰减约束
  • 利用无监督统计特征定位事件边界,降低长视频处理复杂度
  • 采用分层提示策略增强大模型时序推理,适合新异常检测场景

视频异常检测(VAD)旨在识别视频中的异常行为。监督方法需大量领域内训练数据,难以泛化至未见异常;而无需训练的方法虽借助大语言模型(LLM)的先验知识,却在细粒度视觉变化和多样化事件定位上表现不足。为此,我们提出EventVAD,一种结合定制动态图架构与多模态大语言模型(MLLM)的事件感知视频异常检测框架,通过时序-事件推理实现精准检测。首先,采用带时间衰减约束的动态时空图建模,捕获事件相关的视频特征;其次,通过自适应噪声过滤与信号比阈值法,基于无监督统计特征检测事件边界,降低大模型处理长视频的复杂度,并提升其时序一致性推理能力;最后,采用分层提示策略引导大模型进行推理后决策。在UCF-Crime与XD-Violence数据集上的实验表明,使用7B规模的MLLM,EventVAD在无需训练设置下达到当前最优性能,超越多个使用7B及以上规模大模型的强基线。

原文摘要 · Abstract (English)

Video Anomaly Detection~(VAD) focuses on identifying anomalies within videos. Supervised methods require an amount of in-domain training data and often struggle to generalize to unseen anomalies. In contrast, training-free methods leverage the intrinsic world knowledge of large language models (LLMs) to detect anomalies but face challenges in localizing fine-grained visual transitions and diverse events. Therefore, we propose EventVAD, an event-aware video anomaly detection framework that combines tailored dynamic graph architectures and multimodal LLMs through temporal-event reasoning. Specifically, EventVAD first employs dynamic spatiotemporal graph modeling with time-decay constraints to capture event-aware video features. Then, it performs adaptive noise filtering and uses signal ratio thresholding to detect event boundaries via unsupervised statistical features. The statistical boundary detection module reduces the complexity of processing long videos for MLLMs and improves their temporal reasoning through event consistency. Finally, it utilizes a hierarchical prompting strategy to guide MLLMs in performing reasoning before determining final decisions. We conducted extensive experiments on the UCF-Crime and XD-Violence datasets. The results demonstrate that EventVAD with a 7B MLLM achieves state-of-the-art (SOTA) in training-free settings, outperforming strong baselines that use 7B or larger MLLMs.

视频异常检测大模型推理事件感知无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。