用分层树结构动态采样视频,提升异常检测精度与可解释性。
VADTree: Explainable Training-Free Video Anomaly Detection via Hierarchical Granularity-Aware Tree
- 构建分层粒度感知树,自适应划分视频事件边界。
- 在三个数据集上超越现有方法,采样片段减少70%以上。
- 适合需要可解释性与低计算成本的工业级异常检测场景。
视频异常检测(VAD)旨在识别视频中的异常行为。监督方法依赖大量领域内训练数据,且难以提供清晰解释;而无训练方法虽利用预训练模型知识,但固定长度时间窗口采样难以捕捉不同持续时长的异常。为此,本文提出VADTree,采用分层粒度感知树(HGTree)实现灵活采样。该方法基于预训练通用事件边界检测(GEBD)模型的边界置信度,将视频分解为通用事件节点,并通过自适应粗-细层级构建与冗余消除形成HGTree。随后,多维先验注入视觉语言模型(VLMs)以增强节点级异常感知,再由大语言模型(LLMs)对事件节点进行异常推理。最后,采用节点间聚类相关性方法融合多粒度异常分数。在三个挑战性数据集上的实验表明,VADTree在无训练设置下达到领先性能,同时显著减少采样片段数量(降幅超70%)。代码将公开于https://github.com/wenlongli10/VADTree。
原文摘要 · Abstract (English)
Video anomaly detection (VAD) focuses on identifying anomalies in videos. Supervised methods demand substantial in-domain training data and fail to deliver clear explanations for anomalies. In contrast, training-free methods leverage the knowledge reserves and language interactivity of large pre-trained models to detect anomalies. However, the current fixed-length temporal window sampling approaches struggle to accurately capture anomalies with varying temporal spans. Therefore, we propose VADTree that utilizes a Hierarchical Granularityaware Tree (HGTree) structure for flexible sampling in VAD. VADTree leverages the knowledge embedded in a pre-trained Generic Event Boundary Detection (GEBD) model to characterize potential anomaly event boundaries. Specifically, VADTree decomposes the video into generic event nodes based on boundary confidence, and performs adaptive coarse-fine hierarchical structuring and redundancy removal to construct the HGTree. Then, the multi-dimensional priors are injected into the visual language models (VLMs) to enhance the node-wise anomaly perception, and anomaly reasoning for generic event nodes is achieved via large language models (LLMs). Finally, an inter-cluster node correlation method is used to integrate the multi-granularity anomaly scores. Extensive experiments on three challenging datasets demonstrate that VADTree achieves state-of-the-art performance in training-free settings while drastically reducing the number of sampled video segments. The code will be available at https://github.com/wenlongli10/VADTree.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。