arXiv:2608.00975cs.CV2026-08

将视觉语言模型用于实时安全监控,提速近20倍并发现更多违规。

MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection

论文配图:MonitorVLM-v2: A Deployed Vision-Language Framework for Real-Time Safety Violation Detection
图 1 · 摘自论文原文
  • 把复杂的逐步推理转为单步规则判断,提升效率
  • 部署中推理速度提升19.45倍,违规识别量达人工检查2.78倍
  • 适合工业级实时、可审计的安全监控场景

大型视觉-语言模型(VLM)虽能对复杂视觉场景进行逐步推理,但其开放式的自回归链式思维(CoT)方式在工业安防等安全关键场景中不适用,因决策需确定性、低延迟且支持多路并发。由于CoT推理开销随推理长度和并发流数增长,造成吞吐瓶颈,难以实现工业级实时多流监控。本文提出MonitorVLM-v2,一个面向部署的视觉-语言框架,将VLM驱动的安全评估重构为有限规则空间内的概率推理,将多模态推理压缩为单步规则识别,将解码从可变长度序列变为单个标记。我们引入符号策略优化(SymPO),一种新颖的对比策略优化算法,增强该有限符号空间内的决策边界,并设计基于熵的分流机制,将不确定预测路由至人工审核员确认。在地下矿场10路摄像头连续四个月的现场部署中,MonitorVLM-v2实现19.45倍的推理加速,并识别出2.78倍于传统人工巡检的已确认违规事件,验证了压缩符号决策在实时、可审计工业监控中的实用价值。

原文摘要 · Abstract (English)

Large vision--language models (VLMs) can reason step by step about complex visual scenes, but this open-ended, autoregressive chain-of-thought (CoT) approach is poorly suited to safety-critical, rule-governed settings such as industrial surveillance, where decisions must be bounded, deterministic, and low-latency. Because CoT inference cost scales jointly with reasoning length and the number of concurrent streams, it creates a throughput bottleneck that precludes the real-time, multistream monitoring required for industrial accountability. Here we present MonitorVLM-v2, a deployment-oriented framework that recasts VLM-based safety assessment as probabilistic inference over a finite regulatory decision space, compressing multimodal reasoning into single-step rule-ID predictions and reducing decoding from a variable-length sequence to a single token. We introduce symbolic policy optimization (SymPO), a novel contrastive policy optimization algorithm that sharpens decision boundaries within this finite symbolic space, together with an entropy-driven triage mechanism that routes uncertain predictions to human reviewers for expert confirmation. In a four-month prospective deployment across 10 concurrent camera feeds in an operational underground mining facility, MonitorVLM-v2 achieved a 19.45-fold increase in inference speed and identified 2.78 times as many confirmed violations as the site's routine manual inspection workflow, demonstrating the practical value of compressed symbolic decision-making for real-time, auditable industrial monitoring.

视觉语言模型实时监控工业安全符号推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。