arXiv:2606.07669cs.CVcs.AI2026-06中稿 · IJCAI被引 1

用动态语义记忆实现边缘端高效异常检测,降低通信开销。

MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarios

论文配图:MemoVAD: Resource-Efficient Video Anomaly Detection via Dynamic Semantic Memory in Edge Computing Scenarios
图 1 · 摘自论文原文
  • 边缘端轻量检测+时序编码,仅对不确定片段调用云端视觉语言模型。
  • 在UCF-Crime和XD-Violence上通信量减少超50%,性能超越现有方法。
  • 适合资源受限的实时监控场景,尤其适用于边缘计算部署。

在真实监控中部署视频异常检测面临高语义需求与边缘设备算力有限之间的矛盾。视觉语言模型(VLM)虽具备丰富开放词汇语义,但其延迟和计算成本限制了本地部署。为此,我们提出MemoVAD,一种边缘-云协同框架,仅在流式检测中选择性引入VLM语义。该框架在边缘端运行轻量级检测器与因果时序上下文编码器(TCE)以建模时间依赖关系。通过基于主观逻辑的不确定性感知门控(UAG)策略,仅对高不确定性及语义新颖片段请求云端VLM。此外,设计动态语义记忆(DSM)缓存经验证的原型,通过语义适配器使边缘模型逐步融合VLM级语义。在真实边缘设备上的UCF-Crime和XD-Violence数据集实验表明,MemoVAD显著降低通信开销,同时超越当前最优性能。

原文摘要 · Abstract (English)

Deploying Video Anomaly Detection (VAD) in real-world surveillance faces a fundamental tension between the demand for high-level semantics to ensure effectiveness and the limited computational resources of edge devices. Vision-Language Models (VLMs) provide rich open-vocabulary semantics, but their latency and computational cost preclude on-device deployment. To address the challenge, we propose MemoVAD, an edge-cloud collaborative framework that selectively incorporates VLM semantics into streaming VAD. MemoVAD runs most inference on the edge with a lightweight detector and a causal Temporal Context Encoder (TCE) to model temporal dependencies. Specifically, we introduce an Uncertainty-Aware Gating (UAG) policy grounded in Subjective Logic to model perceived uncertainty and query the cloud-based VLM only for high-uncertainty and semantically novel clips. Besides, a Dynamic Semantic Memory (DSM) is designed to cache VLM-verified prototypes for efficient retrieval, enabling the edge model to progressively incorporate VLM-level semantics via a semantic adapter. Experiments on UCF-Crime and XD-Violence datasets via a real edge device show that MemoVAD substantially reduces communication overhead while surpassing state-of-the-art performance.

视频异常检测边缘计算视觉语言模型语义记忆

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。