提出从看、查到思考的视频异常检测新范式,兼顾定位精度与语义理解。
Glance, Scrutinize, and Think: Advancing Video Anomaly Detection from Training-Free to Agentic Reasoning

- 借鉴人类看监控的分步思维:先全局扫描,再聚焦可疑片段,迭代修正。
- 训练零成本的GtS框架实现粗粒度到细粒度的异常定位与理解,速度与精度兼备。
- 引入可调用工具的智能体模型,通过自我修正提升检测准确率,适合高要求场景。
视频异常检测(VAD)旨在识别异常事件并定位其时间区间。现有方法存在“何时-何事”割裂:传统深度神经网络方法能定位异常发生时间但缺乏语义理解,而大语言模型方法能解释事件内容却忽略精确的时间锚定。我们归因于缺乏统一的推理范式。受人类巡查监控视频方式启发——先全局扫视形成时间假设,再细致检查可疑段落,并通过迭代思考纠正错误——我们从全局到局部的范式出发进行研究。首先提出训练免的Glance then Scrutinize(GtS)框架,利用静态与动态文本引导实现粗粒度到细粒度的异常定位与理解,平衡准确性与速度。为突破冻结外部模块的性能瓶颈,进一步提出一种工具增强型智能体VAD方法:多模态大语言模型学会调用视频裁剪工具、密集采样帧进行检查,并通过冷启动监督微调结合强化学习与联合答案-定位奖励进行自我纠错。为训练与评估,我们将先前的VAGU基准扩展为VAGU-T(Video Anomaly Grounding, Understanding, and Thinking),包含7,567个真实世界视频,覆盖21类异常,具备人工验证的定位结果、解释、问答对及链式思考工具调用轨迹。同时引入JeAUG指标,联合评估语义可解释性与时间精度。实验表明,GtS显著优于无训练基线,而智能体模型在更高准确率下也实现更快推理。
原文摘要 · Abstract (English)
Video Anomaly Detection (VAD) aims to identify anomalous events and localize their temporal intervals. Existing approaches exhibit a "when-what" dissociation: traditional DNN-based methods localize when anomalies occur but lack semantic understanding, whereas LLM-based methods explain what happens but neglect precise temporal grounding. We attribute this to the absence of a unified reasoning paradigm. Inspired by how humans inspect surveillance videos - glancing globally to form temporal hypotheses, scrutinizing suspicious segments, and thinking iteratively to correct errors - we study this global-to-local paradigm from two perspectives. We first propose Glance then Scrutinize (GtS), a training-free framework using static and dynamic textual guidance for coarse-to-fine anomaly grounding and understanding, balancing accuracy and speed. To break the ceiling imposed by frozen external modules, we further propose a tool-augmented agentic VAD method, where a multimodal large language model learns to invoke a video cropping tool, inspect densely resampled frames, and self-correct mislocalized hypotheses, via cold-start supervised fine-tuning followed by reinforcement learning with a joint answer-grounding reward. For training and evaluation, we extend our prior VAGU benchmark into VAGU-T (Video Anomaly Grounding, Understanding, and Thinking), comprising 7,567 real-world videos over 21 anomaly categories with human-validated grounding, explanations, QA pairs, and chain-of-thought tool-calling traces. We further introduce JeAUG, a metric jointly evaluating semantic interpretability and temporal precision. Experiments show that GtS substantially surpasses training-free baselines, while the agentic model delivers both higher accuracy and faster inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。