arXiv:2512.18809cs.CVcs.AI2025-12被引 1

在手机上实现视频暴力检测,既保护隐私又省带宽。

FedVideoMAE: Efficient Privacy-Preserving Federated Video Moderation

  • 用自监督模型+低秩适配,只传少量参数
  • 通信量减少28.3倍,隐私保护下准确率达65%~66%
  • 适合移动端部署,兼顾隐私与效率

短时视频内容审核亟需既能保护用户隐私,又不依赖云端高带宽、低延迟推理的学习框架。本文提出 FedVideoMAE,一种基于设备端联邦学习的视频暴力检测框架,结合自监督 VideoMAE 表示、基于 LoRA 的参数高效适配、客户端差分隐私随机梯度下降(DP-SGD)以及服务端安全聚合。通过仅更新 550 万参数(约 15600 万主干网络的 3.5%),相比全模型联邦更新,通信量降低 28.3 倍,同时全程保持原始视频在本地设备。在 40 个客户端的 RWF-2000 数据集上,无隐私保护时达到 77.25% 准确率,强差分隐私下为 65%~66%。我们进一步通过面向小数据、参数高效联邦场景的有效信噪比分析发现,该设置中差分隐私噪声放大约 8.5~12 倍。我们还对比了历史全模型联邦基线,并总结了在 RLVS 与二分类 UCF-Crime 上的迁移行为。这些结果表明,FedVideoMAE 是边缘设备上隐私保护视频审核的一个实用方案。

原文摘要 · Abstract (English)

Short-form video moderation increasingly needs learning pipelines that protect user privacy without paying the full bandwidth and latency cost of cloud-centralized inference. We present FedVideoMAE, an on-device federated framework for video violence detection that combines self-supervised VideoMAE representations, LoRA-based parameter-efficient adaptation, client-side DP-SGD, and server-side secure aggregation. By updating only 5.5M parameters (about 3.5% of a 156M backbone), FedVideoMAE reduces communication by 28.3x relative to full-model federated updates while keeping raw videos on device throughout training. On RWF-2000 with 40 clients, the method reaches 77.25% accuracy without privacy protection and 65~66% under strong differential privacy. We further show that this privacy gap is consistent with an effective-SNR analysis tailored to the small-data, parameter-efficient federated regime, which indicates roughly 8.5~12x DP-noise amplification in our setting. To situate these results more clearly, we also compare against archived full-model federated baselines and summarize auxiliary transfer behavior on RLVS and binary UCF-Crime. Taken together, these findings position FedVideoMAE as a practical operating point for privacy-preserving video moderation on edge devices. Our code can be found at: https://github.com/zyt-599/FedVideoMAE.

视频生成联邦学习隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。