arXiv:2608.05069cs.CVcs.AI2026-08

用离散向量量化学习人体动作模式,高效检测监控视频中的异常行为。

VQ-VAD: Vector-quantized Motion Representation Learning for Human-centric Video Anomaly Detection

  • 将VQ-GAN用于关键点序列,构建正常动作的离散代码本
  • 在HR-SHT数据集上达81.83%准确率,跨域迁移达76.69%
  • 适合关注动作异常检测与隐私保护的研究者

视频异常检测因异常样本稀缺及监控视频中光照、视角、人体外观变化大而极具挑战。为降低视觉噪声并保护隐私,现有方法转向基于姿态的检测,聚焦运动动态而非原始视频。然而,现有方法在连续潜在空间建模行为,难以学习紧凑的运动模式。本文提出向量量化视频异常检测(VQ-VAD),一种以人为中心的新框架,通过离散化运动表示提升鲁棒性。VQ-VAD改编用于图像生成的向量量化生成对抗网络(VQ-GAN),应用于关键点序列,构建正常行为的运动代码本。仅在正常运动序列上训练,通过重建误差识别异常。在四个基准数据集上进行三类评估:域内、跨域与跨数据集泛化。实验表明,该方法在域内达到81.83%准确率(HR-SHT[15]),从CMU Panoptic[14]跨域迁移至HR-SHT无需重训练即达76.69%,具备良好跨数据集鲁棒性。代码已开源。

原文摘要 · Abstract (English)

Video Anomaly Detection (VAD) is inherently challenging due to the scarcity of anomalies and the large visual variability in surveillance footage, including changes in lighting, viewpoint, and human appearance. To mitigate visual noise and address privacy concerns, recent work has shifted to pose-based VAD, which focuses on motion dynamics rather than raw video data. However, existing pose-based approaches model human behavior in continuous latent spaces, limiting their ability to learn compact motion patterns necessary for robust behavior analysis. We address this by proposing Vector-Quantized Video Anomaly Detection (VQ-VAD), a novel human-centric anomaly detection framework that learns discrete motion representations. VQ-VAD adapts Vector-Quantized GAN (VQ-GAN), originally developed for image generation, to operate on keypoint sequences and construct a motion codebook of normal behavior. Trained exclusively on normal motion sequences, VQ-VAD detects anomalies by identifying high reconstruction errors when an observed motion sequence cannot be mapped to the learned codebook. We conduct extensive experiments across three complementary evaluation settings, including in-domain, cross-domain, and cross-dataset generalization, on four anomaly detection benchmarks. VQ-VAD achieves strong in-domain accuracy (81.83% on HR-SHT [15]), effective cross-domain transfer from CMU Panoptic [14] (76.69% on HR-SHT [15] without retraining), and competitive cross-dataset robustness. The code base for this work is available at https://github.com/TeCSAR-UNCC/VQ-VAD.

异常检测动作分析向量量化姿态追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。