通过分阶段学习,提升跨画质深度伪造视频检测能力
DPL: Cross-quality DeepFake Detection via Dual Progressive Learning
- 设计双分支渐进学习框架,按画质等级逐步挖掘伪造痕迹
- 在多个数据集上达到领先性能,尤其在低画质场景下优势明显
- 适合需要应对真实世界画质波动的深度伪造检测应用
现实中的深度伪造视频常经历多种压缩操作,导致画质参差不齐。不同画质会改变伪造痕迹模式,显著增加检测难度。为此,我们提出一种新的双阶段渐进学习(DPL)框架用于跨画质深度伪造检测。将该任务类比为逐层钻探地下水:画质越低,所需挖掘努力越大。我们设计两个基于时序的分支,分别以不同努力程度“钻探”伪造痕迹。第一分支根据专用CLIP指标确定的视频质量等级,按时间步逐步挖掘伪造特征;其中引入特征选择模块,自适应分配对应时间步的特征。考虑到同一画质下不同生成技术可能产生差异化的伪造痕迹,第二分支以伪造可识别性为目标进行补充,结构与第一分支相似,并共享特征选择模块。该设计利用序列模型中权重共享与历史记忆特性,实现渐进学习的同时控制内存开销。大量实验表明,该方法在跨画质深度伪造检测中具有显著优势。
原文摘要 · Abstract (English)
Real-world DeepFake videos often undergo various compression operations, resulting in a range of video qualities. These varying qualities diversify the pattern of forgery traces, significantly increasing the difficulty of DeepFake detection. To address this challenge, we introduce a new Dual Progressive Learning (DPL) framework for cross-quality DeepFake detection. We liken this task to progressively drilling for underground water, where low-quality videos require more effort than high-quality ones. To achieve this, we develop two sequential-based branches to "drill waters" with different efforts. The first branch progressively excavates the forgery traces according to the levels of video quality, i.e., time steps, determined by a dedicated CLIP-based indicator. In this branch, a Feature Selection Module is designed to adaptively assign appropriate features to the corresponding time steps. Considering that different techniques may introduce varying forgery traces within the same video quality, we design a second branch targeting forgery identifiability as complementary. This branch operates similarly and shares the feature selection module with the first branch. Our design takes advantage of the sequential model where computational units share weights across different time steps and can memorize previous progress, elegantly achieving progressive learning while maintaining reasonable memory costs. Extensive experiments demonstrate the superiority of our method for cross-quality DeepFake detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。