用人体检测与时空建模,提升监控视频异常行为识别准确率
Human-Centric Anomaly Detection in Surveillance Videos Using YOLO-World and Spatio-Temporal Deep Learning
- 先用YOLO-World定位人体,再通过高斯模糊抑制背景干扰
- 在UCF-Crime数据集上达到92.41%平均准确率,各类别F1均超0.85
- 适合关注真实场景下异常检测的工程与研究者
由于异常事件多样性、类别不平衡及场景依赖性视觉干扰,监控视频中的异常检测仍具挑战。本文提出一种融合人体中心预处理与时空建模的深度学习框架,用于多类异常分类。流程首先使用YOLO-World(开放词汇视觉语言检测器)识别视频片段中的人体实例,并采用ByteTrack实现身份一致追踪;通过高斯模糊抑制检测框外的背景区域,有效降低场景干扰,聚焦于行为相关前景内容。随后,利用ImageNet预训练的InceptionV3提取空间特征,结合双向LSTM(BiLSTM)捕捉时序动态,完成序列级分类。在UCF-Crime数据集的五类子集(正常、入室盗窃、打斗、纵火、爆炸)上,方法在三次独立实验中平均测试准确率达92.41%,各类别F1分数均超过0.85。综合混淆矩阵、ROC曲线及宏/加权平均指标表明模型具备良好泛化能力与对类别不平衡的鲁棒性。结果验证了前景聚焦预处理对真实监控场景中异常判别的显著提升作用。
原文摘要 · Abstract (English)
Anomaly detection in surveillance videos remains a challenging task due to the diversity of abnormal events, class imbalance, and scene-dependent visual clutter. To address these issues, we propose a robust deep learning framework that integrates human-centric preprocessing with spatio-temporal modeling for multi-class anomaly classification. Our pipeline begins by applying YOLO-World - an open-vocabulary vision-language detector - to identify human instances in raw video clips, followed by ByteTrack for consistent identity-aware tracking. Background regions outside detected bounding boxes are suppressed via Gaussian blurring, effectively reducing scene-specific distractions and focusing the model on behaviorally relevant foreground content. The refined frames are then processed by an ImageNet-pretrained InceptionV3 network for spatial feature extraction, and temporal dynamics are captured using a bidirectional LSTM (BiLSTM) for sequence-level classification. Evaluated on a five-class subset of the UCF-Crime dataset (Normal, Burglary, Fighting, Arson, Explosion), our method achieves a mean test accuracy of 92.41% across three independent trials, with per-class F1-scores consistently exceeding 0.85. Comprehensive evaluation metrics - including confusion matrices, ROC curves, and macro/weighted averages - demonstrate strong generalization and resilience to class imbalance. The results confirm that foreground-focused preprocessing significantly enhances anomaly discrimination in real-world surveillance scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。