用局部区域扰动生成假异常,提升弱监督视频异常检测的抗攻击能力。
FrameShield: Adversarially Robust Video Anomaly Detection

- 通过时空区域扭曲生成合成异常,提升伪标签质量
- 在多个基准上平均提升71.0%的AUROC性能
- 适合需要高鲁棒性的工业异常检测场景
弱监督视频异常检测(WSVAD)虽取得显著进展,但现有模型仍易受对抗攻击影响,可靠性受限。由于弱监督仅提供视频级标签却需帧级预测,传统对抗防御如对抗训练效果不佳,因视频级扰动通常较弱。为此,我们提出一种新型伪异常生成方法——时空区域扭曲(SRD),通过在正常视频的局部区域施加强烈增强并保持时序一致性,生成合成异常。将这些精确标注的合成异常与原始噪声伪标签结合,显著降低标签噪声,实现有效的帧级对抗训练。大量实验表明,本方法显著提升了WSVAD模型对对抗攻击的鲁棒性,在多个基准上平均提升71.0%的总体AUROC性能。代码已公开于https://github.com/rohban-lab/FrameShield。
原文摘要 · Abstract (English)
Weakly Supervised Video Anomaly Detection (WSVAD) has achieved notable advancements, yet existing models remain vulnerable to adversarial attacks, limiting their reliability. Due to the inherent constraints of weak supervision, where only video-level labels are provided despite the need for frame-level predictions, traditional adversarial defense mechanisms, such as adversarial training, are not effective since video-level adversarial perturbations are typically weak and inadequate. To address this limitation, pseudo-labels generated directly from the model can enable frame-level adversarial training; however, these pseudo-labels are inherently noisy, significantly degrading performance. We therefore introduce a novel Pseudo-Anomaly Generation method called Spatiotemporal Region Distortion (SRD), which creates synthetic anomalies by applying severe augmentations to localized regions in normal videos while preserving temporal consistency. Integrating these precisely annotated synthetic anomalies with the noisy pseudo-labels substantially reduces label noise, enabling effective adversarial training. Extensive experiments demonstrate that our method significantly enhances the robustness of WSVAD models against adversarial attacks, outperforming state-of-the-art methods by an average of 71.0\% in overall AUROC performance across multiple benchmarks. The implementation and code are publicly available at https://github.com/rohban-lab/FrameShield.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。