arXiv:2410.21991cs.CVcs.AI2024-10被引 1

轻量双分支系统让家用摄像头实时识别异常,误报率更低。

A Lightweight Dual-Branch System for Weakly-Supervised Video Anomaly Detection on Consumer Edge Devices

  • 双分支设计:视觉粗筛+多模态细检,降低计算负担。
  • 在XD-Violence和UCF-Crime上准确率超现有方法,速度更快。
  • 可部署于NVIDIA Jetson Nano,适合普通智能设备使用。

消费电子中智能安防需求增长,但先进AI模型因计算成本高、模型大,难以在资源受限的边缘设备上实现实时视频异常检测。为此,本文提出轻量级规则驱动系统RuleVAD,专为消费级硬件设计。该系统采用解耦双分支架构:隐式分支利用视觉特征进行快速粗粒度二分类,高效过滤正常行为;显式分支结合YOLO-World目标检测与数据挖掘,生成可解释的文本关联规则,结合视觉数据实现细粒度分类,显著降低视觉单一系统常见的误报。在XD-Violence与UCF-Crime基准数据集上的实验表明,RuleVAD在准确率和速度上均优于现有最先进方法。系统全程优化低功耗,可完整部署于NVIDIA Jetson Nano开发板,验证了其在日常消费设备中实现高级实时安全监控的可行性。

原文摘要 · Abstract (English)

The growing demand for intelligent security in consumer electronics, such as smart home cameras and personal monitoring systems, is often hindered by the high computational cost and large model sizes of advanced AI. These limitations prevent the effective deployment of real-time Video Anomaly Detection (VAD) on resource-constrained edge devices. To bridge this gap, this paper introduces Rule-based Video Anomaly Detection (RuleVAD), a novel, lightweight system engineered for high-efficiency and low-complexity threat detection directly on consumer hardware. RuleVAD features an innovative decoupled dual-branch architecture to minimize computational load. An implicit branch uses visual features for rapid, coarse-grained binary classification, efficiently filtering out normal activity to avoid unnecessary processing. For potentially anomalous or complex events, a multimodal explicit branch takes over. This branch leverages YOLO-World to detect objects and applies data mining to generate interpretable, text-based association rules from the scene. By aligning these rules with visual data, RuleVAD achieves a more nuanced, fine-grained classification, significantly reducing the false alarms common in vision-only systems. Extensive experiments on the XD-Violence and UCF-Crime benchmark datasets show that RuleVAD achieves superior performance, surpassing existing state-of-the-art methods in both accuracy and speed. Crucially, the entire system is optimized for low-power operation and is fully deployable on an NVIDIA Jetson Nano board, demonstrating its practical feasibility for bringing advanced, real-time security monitoring to everyday consumer electronic devices.

视频异常检测边缘计算轻量化模型智能安防

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。