arXiv:2609.07403cs.CVcs.AI2026-09

用轻量网关筛选异常视频,减少传输并保护隐私。

Federated Binary Gating with Server-Side Vision-Language Inference for Surveillance Anomaly Classification

论文配图:Federated Binary Gating with Server-Side Vision-Language Inference for Surveillance Anomaly Classification
图 1 · 摘自论文原文
  • 本地用轻量卷积网筛出可疑视频,仅传给服务器
  • 服务器用大模型分类,准确率达0.503(F1-macro)
  • 可调路由策略,平衡隐私、精度与传输量

隐私敏感的监控系统可受益于大型视觉语言模型(VLM),但这类模型通常需访问原始视频。在联邦学习中,非独立同分布的客户端数据使多类异常分类不稳定,尤其对罕见类别。本文提出两阶段混合架构:本地使用轻量级LiteCNN3D门控网络进行异常初筛,仅将标记视频上传至服务器,由Qwen3-VL-8B模型分配至四类异常元类别。在分组为五类粗粒度元类别的UCF-Crime数据集上,采用真实三节点异构部署。直接联邦多分类训练崩溃,而本方案在分类质量与视频传输间取得更好权衡。固定阈值路由下,联邦混合系统保留接近集中式系统的宏平均F1分数(F1-macro=0.503),传输视频比例降至51.4%,但代理宏观受试者工作特征曲线下面积(ROC AUC)较低。采用灵敏度导向路由点后,宏观ROC AUC提升至0.692,漏检率从29.3%降至22.9%,但F1-macro下降至0.485,传输比例升至57.9%。结果表明,联邦学习更适合粗粒度本地筛查,路由规则可灵活调整以权衡服务器大模型使用与异常检测灵敏度。

原文摘要 · Abstract (English)

Privacy-sensitive surveillance systems could benefit from large vision-language models (VLMs), but such models typically require centralized access to raw video. In federated learning settings, this challenge is amplified by non-independent and identically distributed (non-IID) client data, which can make direct multiclass anomaly classification unstable, especially for rare categories. We propose a hybrid two-stage architecture that combines a federated binary convolutional neural network (CNN) gate with server-side zero-shot VLM inference. The lightweight LiteCNN3D gate performs local anomaly screening and forwards only flagged videos to Qwen3-VL-8B, which assigns them to four anomaly metaclasses. We evaluate this design on UCF-Crime grouped into five coarse metaclasses and implement the federated stage in a real three-node heterogeneous deployment. In the studied setting, direct federated multiclass training collapses, whereas the proposed decomposition yields a better trade-off between classification quality and raw-video transmission. With fixed-threshold routing, the federated hybrid pipeline preserves nearly the same macro-averaged F1 score (F1-macro) as its centralized CNN+VLM counterpart while reducing the fraction of transmitted videos to 51.4%, although with a lower proxy macro receiver operating characteristic area under the curve (ROC AUC) than the centralized hybrid system. A complementary sensitivity-oriented routing operating point increases macro ROC AUC from 0.673 to 0.692 and reduces the false negative rate from 29.3% to 22.9%, but decreases F1-macro from 0.503 to 0.485 while increasing transmission from 51.4% to 57.9%. These results suggest that federation is better suited to coarse local screening, while routing rules can be adjusted to trade server-side VLM usage for higher anomaly sensitivity.

联邦学习异常检测视觉语言模型隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。