对比轻量级模型与视觉语言模型在联邦暴力检测中的表现,兼顾精度与能耗。
Frugal Federated Learning for Violence Detection: A Comparison of LoRA-Tuned VLMs and Personalized CNNs
- 用低秩适配微调大模型,或训练小型3D卷积网络实现联邦学习。
- 两者准确率超90%,小模型在ROC AUC和能耗上略优。
- 适合关注隐私保护、能效与可持续部署的视频监控场景。
我们比较了两种资源节约型联邦学习策略在暴力检测中的应用:(i) 零样本及联邦微调视觉语言模型(VLMs),(ii) 轻量级3D卷积神经网络(CNN3D)的个性化训练。以LLaVA-7B和6580万参数的CNN3D为例,在真实非独立同分布条件下评估了准确率、校准性与能耗。两者准确率均超过90%。相比低秩适配(LoRA)微调的VLM,CNN3D在ROC AUC与对数损失上表现更优,且能耗更低;但VLM在上下文推理与多模态理解方面更具优势。研究量化了训练与推理阶段的能耗与碳排放,分析了部署中的可持续性权衡。据我们所知,这是首个针对联邦暴力检测中LoRA微调VLM与个性化CNN对比的系统研究,强调能效与环境指标。结果支持混合架构:日常分类由轻量级CNN完成,复杂或需描述的任务则激活VLM。该框架为资源敏感的视频监控提供了可复现的负责任AI基准,并可扩展至实时、多模态与生命周期感知系统。
原文摘要 · Abstract (English)
We examine frugal federated learning approaches to violence detection by comparing two complementary strategies: (i) zero-shot and federated fine-tuning of vision-language models (VLMs), and (ii) personalized training of a compact 3D convolutional neural network (CNN3D). Using LLaVA-7B and a 65.8M parameter CNN3D as representative cases, we evaluate accuracy, calibration, and energy usage under realistic non-IID settings. Both approaches exceed 90% accuracy. CNN3D slightly outperforms Low-Rank Adaptation(LoRA)-tuned VLMs in ROC AUC and log loss, while using less energy. VLMs remain favorable for contextual reasoning and multimodal inference. We quantify energy and CO$_2$ emissions across training and inference, and analyze sustainability trade-offs for deployment. To our knowledge, this is the first comparative study of LoRA-tuned vision-language models and personalized CNNs for federated violence detection, with an emphasis on energy efficiency and environmental metrics. These findings support a hybrid model: lightweight CNNs for routine classification, with selective VLM activation for complex or descriptive scenarios. The resulting framework offers a reproducible baseline for responsible, resource-aware AI in video surveillance, with extensions toward real-time, multimodal, and lifecycle-aware systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。