arXiv:2605.02912cs.CVcs.AI2026-05

用大模型让视频异常检测既准又懂,还能指哪儿哪儿

Reasoning-Guided Grounding: Elevating Video Anomaly Detection through Multimodal Large Language Models

论文配图:Reasoning-Guided Grounding: Elevating Video Anomaly Detection through Multimodal Large Language Models
图 1 · 摘自论文原文
  • 分三阶段训练,让大模型同时学会分类、定位和推理
  • 在UCF-Crime上达94%准确率,定位F1达84%
  • 输出可读的推理链,适合需要解释性的安全场景

视频异常检测传统上是二分类或离群点检测,缺乏可解释性与精确的空间定位。尽管视觉语言模型具备丰富场景理解能力,但在空间定位上常生成幻觉或几何错误的边界框。我们提出VANGUARD框架,将异常分类、空间定位与思维链推理统一于单一视觉语言模型中。该框架采用三阶段渐进式训练:(1) 冻结主干特征进行分类器预热,(2) 使用LoRA适配实现空间定位,(3) 生成思维链。为应对VAD数据集标注稀疏问题,我们设计教师-学生标注管道,利用Qwen3-VL-4B模型基于UCA数据集人工标注生成每子片段的结构化推理轨迹,并由GroundingDINO提供边界框监督。在UCF-Crime上,VANGUARD达到94% ROC-AUC与84% F1,同时生成可解释的思维链与异常对象空间定位,优于以往方法。消融实验表明分阶段训练优于单一优化,结构化推理作为隐式正则化使预测更均衡。零样本迁移至XD-Violence和ShanghaiTech验证了跨域泛化能力,无需目标域微调。

原文摘要 · Abstract (English)

Video Anomaly Detection (VAD) has traditionally been framed as binary classification or outlier detection, providing neither interpretable reasoning nor precise spatial localization of anomalous events. While Vision-Language Models (VLMs) offer rich scene understanding, they struggle with reliable spatial grounding - often producing hallucinated or geometrically invalid bounding boxes when asked to localize objects. We propose VANGUARD (Video Anomaly Understanding through Reasoning and Grounding), a framework that unifies anomaly classification, spatial grounding, and chain-of-thought reasoning within a single VLM. VANGUARD introduces a three-stage curriculum that progressively layers training objectives: (1) classifier warmup on frozen backbone features, (2) LoRA-adapted spatial grounding, and (3) chain-of-thought generation. To overcome the sparse annotation typical of VAD benchmarks, we employ a teacher-student annotation pipeline in which a VLM (Qwen3-VL-4B) generates structured per-subclip reasoning trajectories based on manual annotations available from the UCA Dataset. Further, GroundingDINO provides bounding box supervision. On UCF-Crime, VANGUARD achieves 94% ROC-AUC with 84% F1 while simultaneously producing interpretable chain-of-thought explanations and spatial grounding of anomalous objects - capabilities absent from prior VAD methods. Ablations confirm that staged training outperforms monolithic optimization, and that structured reasoning acts as an implicit regularizer yielding more balanced predictions than classification-only fine-tuning. Zero-shot transfer to XD-Violence and ShanghaiTech demonstrates cross-domain generalization without target-domain adaptation.

视频异常检测多模态大模型可解释性空间定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。