arXiv:2607.10298cs.CV2026-07

通过结构化证据选择,提升弱监督视频异常检测的定位准确性

Structured Evidence Selection for Weakly Supervised Video Anomaly Detection

论文配图:Structured Evidence Selection for Weakly Supervised Video Anomaly Detection
图 1 · 摘自论文原文
  • 将视频片段重构为语义结构化证据,按场景和动作约束筛选
  • 在三个数据集上分别达到67.92、97.99、88.46的AUC
  • 轻量级几何判别模块增强异常区分能力,适合复杂场景应用

弱监督视频异常检测仅依赖视频级标签训练,难以在复杂场景中准确定位异常事件。真实视频中异常行为在外观和持续时间上变化大,且与场景外观和动作动态高度纠缠,导致现有模型易依赖场景统计线索而非真实行为偏离,性能不稳定。为此,我们提出结构化证据选择框架(SESAD),将异常检测重构为对片段级视觉证据的结构化推理过程。SESAD不直接将聚合特征映射为异常分数,而是将片段表示重组为语义结构化的候选证据,并在场景与动作约束下进行上下文感知选择,自适应强化异常相关语义,抑制场景干扰,缓解弱监督下的语义纠缠。此外,引入轻量级几何判别模块,在嵌入空间构建双原型结构,通过相对几何关系做出异常判断。在UBnormal、ShanghaiTech和UCF-Crime上的大量实验表明,SESAD分别取得67.92、97.99、88.46的AUC,同时保持高计算效率与稳定的异常识别能力。

原文摘要 · Abstract (English)

Weakly supervised video anomaly detection relies solely on video-level labels for training, making it difficult to accurately localize anomalous events in complex scenes. In real-world videos, anomalous behaviors exhibit large variations in appearance and temporal duration, while scene appearance and action dynamics are often tightly entangled. Consequently, existing models tend to rely on scene-related statistical cues rather than true behavioral deviations, resulting in unstable detection performance. To address this challenge, we propose a Structured Evidence Selection framework (SESAD) that reformulates anomaly detection as a structured reasoning process over clip-level visual evidence. Instead of directly mapping aggregated features to anomaly scores, SESAD reorganizes clip representations into semantically structured candidate evidence and performs context-conditioned selection under scene and action constraints. This mechanism adaptively emphasizes anomaly-relevant semantics while suppressing scene interference, thereby alleviating semantic entanglement under weak supervision. Furthermore, we introduce a lightweight geometric discrimination module that constructs a dual-prototype structure in the embedding space, enabling anomaly decisions through relative geometric relations. Extensive experiments on UBnormal, ShanghaiTech, and UCF-Crime show that SESAD achieves 67.92, 97.99, and 88.46 AUC, respectively, while maintaining high computational efficiency and overall consistently stable anomaly discrimination.

视频异常检测弱监督结构化推理几何判别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。