arXiv:2608.21244cs.CV2026-08

用视觉语言模型做视频异常检测时,答案处理方式直接影响结果排名。

A VLM Answer Is Not an Anomaly Score: Rank Compression in Training-Free Video Anomaly Detection

论文配图:A VLM Answer Is Not an Anomaly Score: Rank Compression in Training-Free Video Anomaly Detection
图 1 · 摘自论文原文
  • 采用概率分布而非单一答案生成得分,提升排序精度
  • 相比仅取最高概率答案,平均性能提升5至13个百分点
  • 适合关注模型输出解释性与评分细节的研究者

视觉语言模型通过回答视频片段问题实现无训练视频异常检测。然而,现有VAD基准需为每个片段生成标量异常分数,并以AUROC或AP评估排序效果。因此,基于VLM的检测器必须定义答案接口:答案尺度限定可接受答案范围,读出规则将模型输出分布映射为分数。该接口影响最终排名,属于检测器核心部分而非格式细节。生成读出仅使用最可能答案,而概率读出利用全部可接受答案的分布。在四个7-8B VLM上,概率读出在所有测试组合中均优于生成读出,跨四组基准-指标对平均增益5~13点。差距源于生成读出每段仅保留一个答案值,不同分布的片段可能获得相同分数,导致相对顺序丢失,称为‘生成答案秩压缩’。即使答案尺度允许91个答案,生成读出也仅产生4~18个不同分数,而概率读出保持更精细的分数分辨率。该优势在各类解码策略、提示措辞及联合评分-解释提示下均持续存在。因此,答案接口是VLM-VAD的关键组件,应明确指定并评估。

原文摘要 · Abstract (English)

Vision-language models enable training-free video anomaly detection by answering questions about video segments. VAD benchmarks, however, require a scalar anomaly score for each segment and evaluate the resulting ranking using the AUROC or AP. A VLM-based detector should therefore define an answer interface: the answer scale specifies the admissible answers, and the readout rule maps the model's output distribution to a score. Because this interface can change the evaluated ranking, it is part of the detector rather than a formatting detail. The generated readout uses only the most likely answer, whereas the probability readout uses the full distribution over admissible answers. Across four 7-8B VLMs, the probability readout outperforms the generated readout for every tested combination of answer scale, benchmark, and metric, with average gains ranging from 5 to 13 points across the four benchmark-metric pairs. The gap arises because the generated readout keeps only one answer value per segment, so segment with different answer distributions can receive the same score and lose their relative order. We call this loss of relative order generated-answer rank compression. Even when the answer scale allows 91 answers, the generated readout produces only 4-18 distinct scores, whereas the probability readout retains substantially finer score resolution. The advantage persists under every decoding strategy, prompt wording, and joint scoring-explanation prompt we test. The answer interface is therefore a consequential component of VLM-based VAD and should be explicitly specified and evaluated.

视频异常检测视觉语言模型评分机制无训练检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。