用模拟压缩参数让检测器适应真实社交平台视频。
Bridging the Gap: A Framework for Real-World Video Deepfake Detection via Social Network Compression Emulation
- 从少量上传视频估算压缩与缩放参数,构建本地模拟器。
- 模拟数据与真实上传视频的退化模式高度一致。
- 适合需要部署于真实场景的深度伪造检测研究者。
社交平台上日益增长的AI生成视频对深度伪造检测构成新挑战,因实验室训练的检测器在真实场景中常失效。其关键原因是平台如YouTube、Facebook采用激进且专有的压缩策略,抹除了低层取证线索。但受限于API和数据共享限制,大规模复现此类变换极为困难。为此,我们提出首个框架,通过分析少量上传视频估算压缩与重采样参数,构建本地模拟器,可在无直接API访问情况下,在大规模数据集上重现平台特定伪影。在通过社交网络分享的FaceForensics++视频上的实验表明,模拟数据与真实上传视频的退化模式高度吻合。此外,基于模拟数据微调的检测器性能可媲美使用真实共享媒体训练的模型。该方法为弥合实验室训练与真实部署之间的差距提供了可扩展且实用的解决方案,尤其适用于压缩视频内容这一尚未充分探索的领域。
原文摘要 · Abstract (English)
The growing presence of AI-generated videos on social networks poses new challenges for deepfake detection, as detectors trained under controlled conditions often fail to generalize to real-world scenarios. A key factor behind this gap is the aggressive, proprietary compression applied by platforms like YouTube and Facebook, which launder low-level forensic cues. However, replicating these transformations at scale is difficult due to API limitations and data-sharing constraints. For these reasons, we propose a first framework that emulates the video sharing pipelines of social networks by estimating compression and resizing parameters from a small set of uploaded videos. These parameters enable a local emulator capable of reproducing platform-specific artifacts on large datasets without direct API access. Experiments on FaceForensics++ videos shared via social networks demonstrate that our emulated data closely matches the degradation patterns of real uploads. Furthermore, detectors fine-tuned on emulated videos achieve comparable performance to those trained on actual shared media. Our approach offers a scalable and practical solution for bridging the gap between lab-based training and real-world deployment of deepfake detectors, particularly in the underexplored domain of compressed video content.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。