多任务深度学习框架实现实时智能安防,误报率降低90%以上。
A Multi-Task Deep Learning Framework for Real-Time Intelligent Video Surveillance with Temporal Event Validation
- 共享GPU平台并行处理人脸、车牌、武器等六类任务
- 引入时序验证机制,火烟误报率从52%降至4%
- 在消费级硬件上保持每帧低于100毫秒延迟
现代视频监控系统产生的视频流远超人工可监控范围,自动化分析对及时发现安全事件至关重要。本文提出一个统一的多任务深度学习框架,在共享GPU平台上同时完成基于区域授权的人脸识别、车牌识别、武器检测、火灾与烟雾检测及人体动作识别。其中,针对公开数据集覆盖不足的场景,提出两个专用模型:基于合并重标注数据集微调的单类武器检测器,[email protected]达0.947;在自建包含614段视频的破坏行为数据集上训练的SlowFast-R50动作识别模型,分类准确率达94.33%。为提升连续视频中的鲁棒性,所有检测模块集成于基于多帧确认、置信度加权投票与级联过滤的时序事件验证架构中,将帧级预测转化为可靠安全事件。各模块在标准公开数据集(LFW、D-Fire、FIRESENSE、UCF-Crime)上独立评估,并进行端到端系统测试。该策略使火烟误报率从52%降至4%,车牌精确匹配率从66.7%提升至81.8%,整体框架在通用硬件上实现每帧延迟低于100毫秒的实时运行。结果表明,结合专用模型与时序验证能有效实现可靠实时智能视频监控。
原文摘要 · Abstract (English)
Modern video surveillance systems generate far more video streams than human operators can effectively monitor, making automated analysis essential for timely detection of security events. This paper presents a unified multi-task deep learning framework that simultaneously performs face recognition with zone-based authorization, automatic license plate recognition, weapon detection, fire and smoke detection, and human action recognition on a shared GPU platform. Among the integrated modules, two task-specific deep-learning models are proposed in this work to address scenarios that are insufficiently represented in publicly available datasets: a single-class weapon detector fine-tuned on a merged and relabeled dataset, achieving a mean average precision ([email protected]) of 0.947, and a SlowFast-R50 action recognition model trained on a purpose-built vandalism dataset comprising 614 video clips, achieving 94.33% classification accuracy. To improve robustness in continuous video, all detection modules are integrated into a temporal event-validation architecture based on multi-frame confirmation, confidence-weighted voting, and cascaded filtering, transforming frame-level predictions into reliable security events. Each module is evaluated independently on established public datasets (LFW, D-Fire, FIRESENSE, and UCF-Crime), followed by integrated end-to-end system evaluation. The proposed temporal validation strategy reduces the fire and smoke false-alarm rate from 52% to 4% and improves video license plate exact-match accuracy from 66.7% to 81.8%, while the complete framework maintains real-time operation with a per-frame latency below 100 ms on commodity hardware. These results demonstrate that combining specialized deep-learning models with temporal event validation provides an effective and practical solution for reliable real-time intelligent video surveillance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。