通过几何感知语义推理,实现无需训练的视频异常检测
Geometry-Aware Semantic Reasoning for Training Free Video Anomaly Detection
- 将场景表征投影到双曲空间,保留层级结构
- 测试时自适应优化轻量提示,提升预测稳定性
- 适合复杂场景下需要可解释性的异常检测任务
无监督视频异常检测(VAD)近年来成为有监督方法的可扩展替代方案,但现有方法多依赖静态提示和忽略几何结构的特征融合。这导致异常判断常简化为欧几里得嵌入间的浅层相似性匹配,预测不稳定且可解释性差,尤其在复杂或分层场景中表现不佳。我们提出MM-VAD,一种面向无训练视频异常检测的几何感知语义推理框架,将异常检测重构为自适应的测试时推理过程而非固定特征对比。该方法将文本提示生成的场景表征投影至双曲空间以更好地保留层级结构,并通过冻结的大语言模型执行自适应问答式异常评估。在测试时,使用无监督置信度-稀疏性目标优化一个轻量级可学习提示,实现上下文相关的校准,且不更新任何主干参数。为进一步将语义预测与视觉证据对齐,引入协方差感知的马氏距离修正,稳定跨模态对齐。在四个基准数据集上,MM-VAD持续优于已有无训练方法,在XD-Violence上达到90.03% AUC,UCF-Crime、ShanghaiTech、UCSD Ped2上分别达到83.24%、96.95%、98.81%。
原文摘要 · Abstract (English)
Training-free video anomaly detection (VAD) has recently emerged as a scalable alternative to supervised approaches, yet existing methods largely rely on static prompting and geometry-agnostic feature fusion. As a result, anomaly inference is often reduced to shallow similarity matching over Euclidean embeddings, leading to unstable predictions and limited interpretability, especially in complex or hierarchically structured scenes. We introduce MM-VAD, a geometry-aware semantic reasoning framework for training free VAD that reframes anomaly detection as adaptive test-time inference rather than fixed feature comparison. Our approach projects caption-derived scene representations into hyperbolic space to better preserve hierarchical structure and performs anomaly assessment through an adaptive question answering process over a frozen large language model. A lightweight, learnable prompt is optimised at test time using an unsupervised confidence-sparsity objective, enabling context-specific calibration without updating any backbone parameters. To further ground semantic predictions in visual evidence, we incorporate a covariance-aware Mahalanobis refinement that stabilises cross-modal alignment. Across four benchmarks, MM-VAD consistently improves over prior training-free methods, achieving 90.03% AUC on XD-Violence and 83.24%, 96.95%, and 98.81% on UCF-Crime, ShanghaiTech, and UCSD Ped2, respectively. Our results demonstrate that geometry-aware representation and adaptive semantic calibration provide a principled and effective alternative to static Euclidean matching in training-free VAD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。