arXiv:2511.17094cs.CV2025-11

用稀疏推理替代密集计算,让大模型高效检测视频异常

Sparse Reasoning is Enough: Biological-Inspired Framework for Video Anomaly Detection with Large Pre-trained Models

  • 模仿人体神经双通路,分轻重处理视频帧
  • 仅处理28.55%帧即达顶尖性能,计算量大幅降低
  • 适合需要低延迟的监控与自动驾驶场景

视频异常检测(VAD)在安防、自动驾驶和工业监控中至关重要。大预训练模型为免训练VAD提供了新可能,但现有方法多依赖密集帧推理,带来高计算开销与延迟。本文提出受生物神经机制启发的ReCoVAD框架,通过双通路实现选择性帧处理:(i)反射通路使用轻量级CLIP模块融合视觉特征与原型提示,快速生成决策向量并查询动态记忆中的历史帧与异常分数;(ii)意识通路采用中等规模视觉语言模型生成事件描述并优化异常评分。两者持续更新记忆与原型,集成大语言模型周期性审查累积描述,识别未见异常、纠正错误并优化原型。在UCF-Crime和XD-Violence数据集上,ReCoVAD仅需前人方法28.55%和16.04%的帧数,即达到当前最优免训练性能,证明稀疏推理足以支撑大模型高效完成视频异常检测。

原文摘要 · Abstract (English)

Video anomaly detection (VAD) plays a vital role in real-world applications such as security surveillance, autonomous driving, and industrial monitoring. Recent advances in large pre-trained models have opened new opportunities for training-free VAD by leveraging rich prior knowledge and general reasoning capabilities. However, existing studies typically rely on dense frame-level inference, incurring high computational costs and latency. This raises a fundamental question: Is dense reasoning truly necessary when using powerful pre-trained models in VAD systems? To answer this, we propose ReCoVAD, a novel framework inspired by the dual reflex and conscious pathways of the human nervous system, enabling selective frame processing to reduce redundant computation. ReCoVAD consists of two core pathways: (i) a Reflex pathway that uses a lightweight CLIP-based module to fuse visual features with prototype prompts and produce decision vectors, which query a dynamic memory of past frames and anomaly scores for fast response; and (ii) a Conscious pathway that employs a medium-scale vision-language model to generate textual event descriptions and refined anomaly scores for novel frames. It continuously updates the memory and prototype prompts, while an integrated large language model periodically reviews accumulated descriptions to identify unseen anomalies, correct errors, and refine prototypes. Extensive experiments show that ReCoVAD achieves state-of-the-art training-free performance while processing only 28.55\% and 16.04\% of the frames used by previous methods on the UCF-Crime and XD-Violence datasets, demonstrating that sparse reasoning is sufficient for effective large-model-based VAD.

视频异常检测大模型推理稀疏计算双通路机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。