arXiv:2608.08887cs.CVcs.CY2026-08

一个统一平台同时检测人脸、车牌、火灾等六类城市安全威胁,实现实时响应。

City Sentinel: A Unified AI-Based Smart Surveillance Framework for Real-Time Multi-Threat Detection Using Deep Learning

论文配图:City Sentinel: A Unified AI-Based Smart Surveillance Framework for Real-Time Multi-Threat Detection Using Deep Learning
图 1 · 摘自论文原文
  • 整合六种检测模型于单一平台,支持多任务并行处理。
  • 端到端延迟743毫秒,识别准确率达91.2%(人脸)和85.7%(车牌)。
  • 适合城市安防运维人员快速部署,支持模块化扩展新功能。

快速城市化加剧了对多风险实时监控的需求。传统系统分属不同模块,导致管理复杂。本文提出City Sentinel,一个统一的AI安防框架,集成人脸识别、车牌识别(ANPR)、火烟检测、武器与刀具检测、暴力行为检测及道路事故检测共六项能力。系统基于Next.js操作界面、FastAPI后端、云存储的PostgreSQL事件库,结合InsightFace与YOLOv8视觉模型及EasyOCR进行车牌识别,通过RTSP流处理视频。在搭载NVIDIA RTX 3060 GPU的工作站上,系统实现743毫秒中位数端到端延迟,支持四路并发流且延迟低于2秒。人脸匹配率91.2%,车牌识别准确率85.7%,火、刀、武器检测模块[email protected]达0.846至0.889。用户测试显示,注册新身份平均耗时不足1分钟,从实时画面中定位目标平均仅需12秒。结果表明,该模块化开源架构可实现广覆盖、可审计、易扩展的实时智能监控。

原文摘要 · Abstract (English)

Rapid urbanization has increased the need for surveillance systems that can monitor multiple public safety risks at the same time. Traditional systems often use separate solutions for facial recognition, vehicle identification, fire detection, and behavioral analysis, resulting in fragmented infrastructure and multiple interfaces for operators to manage. This paper presents City Sentinel, a unified AI-based surveillance framework that integrates six detection capabilities into one scalable platform: facial recognition, automatic number plate recognition (ANPR), fire and smoke detection, weapon and knife detection, violence detection, and road accident detection. The system combines a Next.js operator dashboard, FastAPI backend, cloud-based PostgreSQL event storage, InsightFace and YOLOv8 vision models, and EasyOCR for plate recognition. Camera streams are processed through dedicated inference workers using RTSP. On a workstation equipped with an NVIDIA RTX 3060 GPU, the system achieves a median end-to-end latency of 743 ms and supports four concurrent RTSP streams within a two-second latency limit. It achieves a 91.2% face-match rate, 85.7% plate-reading accuracy, and [email protected] scores of 0.846 to 0.889 across the fire, knife, and weapon detection modules. In user-acceptance testing, operators could enroll a new identity in under one minute and identify a flagged person from live footage in an average of 12 seconds. The results demonstrate that a modular, open-source, multi-model architecture can provide broad surveillance coverage, cloud-based auditability, and flexibility for adding new detection capabilities while maintaining practical real-time performance.

智能安防多任务检测实时推理城市治理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。