轻量级视频异常检测模型,兼顾速度与精度。
Forward Consistency Learning with Gated Context Aggregation for Video Anomaly Detection
- 基于U-Net结构,融合短期与长期时间信息进行预测
- 仅200万参数,推理速度达155帧/秒
- 适合部署在资源受限的边缘设备上
视频异常检测(VAD)是公共安全的重要组成部分,旨在实时识别监控场景中偏离正常模式的行为。然而,现有方法多依赖大规模模型以追求高精度,难以在资源受限的边缘设备上部署。主流基于预测的VAD仅利用单帧未来预测误差检测异常,忽略了更丰富的长期时序前向信息约束。本文提出FoGA模型,一种轻量级的前向一致性学习方法,采用门控上下文聚合机制,参数量约200万,专为边缘设备设计。该模型基于U-Net结构,对连续帧进行特征提取,生成即时与远期预测结果;通过门控模块在跳连路径中动态融合编码器与解码器同尺度特征;并引入新型前向一致性损失,结合即时与远期预测误差的混合异常度量策略进行联合优化。大量实验表明,本方法显著优于当前最优模型,在保持高效的同时达到优异性能,最高可达155 FPS。
原文摘要 · Abstract (English)
As a crucial element of public security, video anomaly detection (VAD) aims to measure deviations from normal patterns for various events in real-time surveillance systems. However, most existing VAD methods rely on large-scale models to pursue extreme accuracy, limiting their feasibility on resource-limited edge devices. Moreover, mainstream prediction-based VAD detects anomalies using only single-frame future prediction errors, overlooking the richer constraints from longer-term temporal forward information. In this paper, we introduce FoGA, a lightweight VAD model that performs Forward consistency learning with Gated context Aggregation, containing about 2M parameters and tailored for potential edge devices. Specifically, we propose a Unet-based method that performs feature extraction on consecutive frames to generate both immediate and forward predictions. Then, we introduce a gated context aggregation module into the skip connections to dynamically fuse encoder and decoder features at the same spatial scale. Finally, the model is jointly optimized with a novel forward consistency loss, and a hybrid anomaly measurement strategy is adopted to integrate errors from both immediate and forward frames for more accurate detection. Extensive experiments demonstrate the effectiveness of the proposed method, which substantially outperforms state-of-the-art competing methods, running up to 155 FPS. Hence, our FoGA achieves an excellent trade-off between performance and the efficiency metric.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。