用频率引导扩散模型+扰动训练,提升骨骼视频异常检测的泛化能力。
Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection
- 通过扰动训练生成相似正常样本,扩展重建域提升泛化性。
- 利用DCT分离高低频运动,优先重建全局特征,避免过度关注局部细节。
- 在5个数据集上超越现有方法,尤其适合开放场景下的异常检测任务。
视频异常检测(VAD)是计算机视觉中一项重要但复杂的开集任务,通常采用基于重构的方法。然而,这些方法存在两大局限:(1)在开集场景下鲁棒性不足,未见过的正常动作常被误判为异常;(2)过度强调局部运动重构,而受限于其多样性,难以准确捕捉。为此,我们提出一种新型频率引导扩散模型结合扰动训练。首先,通过训练生成器产生与正常样本相似的扰动样本,弥补重构模型的弱点,扩展其重建范围,提升对未见正常动作的泛化能力。其次,为缓解对局部细节的过度依赖,采用二维离散余弦变换(DCT)分离高(局部)低(全局)频运动分量,利用观测到的高频信息引导扩散模型,优先重构低频成分,实现更精准、鲁棒的异常检测。在五个常用VAD数据集上的大量实验表明,该方法显著优于当前最先进方法,验证了其在开集场景和多样化运动背景下的有效性。
原文摘要 · Abstract (English)
Video anomaly detection (VAD) is a vital yet complex open-set task in computer vision, commonly tackled through reconstruction-based methods. However, these methods struggle with two key limitations: (1) insufficient robustness in open-set scenarios, where unseen normal motions are frequently misclassified as anomalies, and (2) an overemphasis on, but restricted capacity for, local motion reconstruction, which are inherently difficult to capture accurately due to their diversity. To overcome these challenges, we introduce a novel frequency-guided diffusion model with perturbation training. First, we enhance robustness by training a generator to produce perturbed samples, which are similar to normal samples and target the weakness of the reconstruction model. This training paradigm expands the reconstruction domain of the model, improving its generalization to unseen normal motions. Second, to address the overemphasis on motion details, we employ the 2D Discrete Cosine Transform (DCT) to separate high-frequency (local) and low-frequency (global) motion components. By guiding the diffusion model with observed high-frequency information, we prioritize the reconstruction of low-frequency components, enabling more accurate and robust anomaly detection. Extensive experiments on five widely used VAD datasets demonstrate that our approach surpasses state-of-the-art methods, underscoring its effectiveness in open-set scenarios and diverse motion contexts. Our project website is https://xiaofeng-tan.github.io/projects/FG-Diff/index.html.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。