arXiv:2510.21449cs.CV2025-10NeurIPS被引 10

无需训练,用大模型实时检测视频异常,效果超越现有方法。

MoniTor: Exploiting Large Language Models with Instruction for Online Video Anomaly Detection

  • 用预训练大模型流式处理视频,结合类LSTM机制捕捉时序依赖。
  • 在UCF-Crime和XD-Violence数据集上优于主流方法,且无需训练。
  • 适合需要低延迟、无标注数据的实时监控场景使用。

视频异常检测(VAD)旨在定位视频中的异常行为。近年来,离线VAD因大语言模型(LLM)和视觉-语言模型(VLM)的发展而备受关注,具备更细致理解异常的潜力。然而,由于实时性要求和计算开销,在线VAD研究较少。本文提出一种无需训练的基于记忆的在线评分队列方案(MoniTor),以应对在线VAD的固有挑战。MoniTor将视频流输入VLM,利用预训练大模型能力;通过受长短期记忆(LSTM)启发的预测机制,更有效地建模时序依赖,从而更好理解当前帧。同时,设计评分队列与异常先验,动态存储近期得分,覆盖监控场景中所有异常,为模型提供时间维度上的区分指导。我们在两个大规模数据集(UCF-Crime和XD-Violence)上评估了MoniTor,结果表明其性能超越现有先进方法,且在不依赖训练的情况下表现媲美弱监督方法。代码已开源。

原文摘要 · Abstract (English)

Video Anomaly Detection (VAD) aims to locate unusual activities or behaviors within videos. Recently, offline VAD has garnered substantial research attention, which has been invigorated by the progress in large language models (LLMs) and vision-language models (VLMs), offering the potential for a more nuanced understanding of anomalies. However, online VAD has seldom received attention due to real-time constraints and computational intensity. In this paper, we introduce a novel Memory-based online scoring queue scheme for Training-free VAD (MoniTor), to address the inherent complexities in online VAD. Specifically, MoniTor applies a streaming input to VLMs, leveraging the capabilities of pre-trained large-scale models. To capture temporal dependencies more effectively, we incorporate a novel prediction mechanism inspired by Long Short-Term Memory (LSTM) networks. This ensures the model can effectively model past states and leverage previous predictions to identify anomalous behaviors. Thereby, it better understands the current frame. Moreover, we design a scoring queue and an anomaly prior to dynamically store recent scores and cover all anomalies in the monitoring scenario, providing guidance for LLMs to distinguish between normal and abnormal behaviors over time. We evaluate MoniTor on two large datasets (i.e., UCF-Crime and XD-Violence) containing various surveillance and real-world scenarios. The results demonstrate that MoniTor outperforms state-of-the-art methods and is competitive with weakly supervised methods without training. Code is available at https://github.com/YsTvT/MoniTor.

视频异常检测大模型应用在线推理零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。