arXiv:2508.06318cs.CVcs.AI2025-08ICCV被引 14

用高斯点云引导专家模型,提升弱监督视频异常检测效果

Mixture of Experts Guided by Gaussian Splatters Matters: A new Approach to Weakly-Supervised Video Anomaly Detection

  • 分领域专家模型+高斯点云时序引导,捕捉不同异常类型特征
  • UCF-Crime数据集上达91.58% AUC,优于现有方法
  • 适合处理复杂真实场景中的隐蔽异常,如偷窃行为

视频异常检测(VAD)因异常事件多样性及标注数据稀缺而具挑战性。在弱监督设置下,仅提供视频级标签,但需在帧级别预测。现有模型在简单异常(如爆炸)上表现良好,却难以应对复杂现实事件(如偷窃)。根源在于:(1) 模型共享处理所有异常类型,忽略类别特异性特征;(2) 弱监督信号缺乏精确时间信息,难以捕捉与正常行为交织的细微异常模式。为此,我们提出高斯点云引导的专家混合模型(GS-MoE),采用一组专门学习特定异常类型的专家模型,并通过时序高斯点云损失进行引导,强化时间一致性与弱监督信号。该方法聚焦最可能含异常的时间段,实现更精准全面的异常表征。各专家预测通过混合专家机制融合,建模跨异常模式的复杂关系。实验显示,该方法在UCF-Crime上达到91.58% AUC,XD-Violence和MSAD上也表现优异,显著提升弱监督视频异常检测性能。

原文摘要 · Abstract (English)

Video Anomaly Detection (VAD) is a challenging task due to the variability of anomalous events and the limited availability of labeled data. Under the Weakly-Supervised VAD (WSVAD) paradigm, only video-level labels are provided during training, while predictions are made at the frame level. Although state-of-the-art models perform well on simple anomalies (e.g., explosions), they struggle with complex real-world events (e.g., shoplifting). This difficulty stems from two key issues: (1) the inability of current models to address the diversity of anomaly types, as they process all categories with a shared model, overlooking category-specific features; and (2) the weak supervision signal, which lacks precise temporal information, limiting the ability to capture nuanced anomalous patterns blended with normal events. To address these challenges, we propose Gaussian Splatting-guided Mixture of Experts (GS-MoE), a novel framework that employs a set of expert models, each specialized in capturing specific anomaly types. These experts are guided by a temporal Gaussian splatting loss, enabling the model to leverage temporal consistency and enhance weak supervision. The Gaussian splatting approach encourages a more precise and comprehensive representation of anomalies by focusing on temporal segments most likely to contain abnormal events. The predictions from these specialized experts are integrated through a mixture-of-experts mechanism to model complex relationships across diverse anomaly patterns. Our approach achieves state-of-the-art performance, with a 91.58% AUC on the UCF-Crime dataset, and demonstrates superior results on XD-Violence and MSAD datasets. By leveraging category-specific expertise and temporal guidance, GS-MoE sets a new benchmark for VAD under weak supervision.

视频异常检测弱监督学习专家混合高斯点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。