真实场景中摩尔纹会严重干扰深度伪造检测,影响高达25.4%。
Through the Lens: Benchmarking Deepfake Detectors Against Moiré-Induced Distortions

- 在真实拍摄条件下收集12,832段含摩尔纹的伪造视频进行评测
- 15个主流检测器性能下降最高达25.4%,合成摩尔纹导致准确率降21.4%
- 去摩尔纹方法反而恶化检测效果,适合关注实际部署的团队参考
深度伪造检测在真实场景中仍面临严峻挑战,尤其当手机拍摄数字屏幕时产生的摩尔纹伪影会扭曲检测结果。本研究系统评估了15个顶尖深度伪造检测器在摩尔纹影响下的表现。通过从Celeb-DF、DFD、DFDC、UADFV和FF++数据集采集共12,832段视频(总计35.64小时),涵盖多种屏幕、手机、光照及拍摄角度的真实条件,构建了新的DeepMoiréFake(DMF)数据集,并结合两种合成摩尔纹生成技术展开实验。结果显示,摩尔纹使检测性能最差下降25.4%,合成摩尔纹导致准确率下降21.4%。令人意外的是,原本用于缓解问题的去摩尔纹方法反而使准确率下降最多17.2%。这些发现凸显了检测模型需具备对摩尔纹等现实干扰的鲁棒性,以应对压缩、锐化、模糊等常见问题。通过发布DMF数据集,旨在推动未来研究弥合受控实验与实际应用之间的差距。
原文摘要 · Abstract (English)
Deepfake detection remains a pressing challenge, particularly in real-world settings where smartphone-captured media from digital screens often introduces Moiré artifacts that can distort detection outcomes. This study systematically evaluates state-of-the-art (SOTA) deepfake detectors on Moiré-affected videos, an issue that has received little attention. We collected a dataset of 12,832 videos, spanning 35.64 hours, from the Celeb-DF, DFD, DFDC, UADFV, and FF++ datasets, capturing footage under diverse real-world conditions, including varying screens, smartphones, lighting setups, and camera angles. To further examine the influence of Moiré patterns on deepfake detection, we conducted additional experiments using our DeepMoiréFake, referred to as (DMF) dataset and two synthetic Moiré generation techniques. Across 15 top-performing detectors, our results show that Moiré artifacts degrade performance by as much as 25.4%, while synthetically generated Moiré patterns lead to a 21.4% drop in accuracy. Surprisingly, demoiréing methods, intended as a mitigation approach, instead worsened the problem, reducing accuracy by up to 17.2%. These findings underscore the urgent need for detection models that can robustly handle Moiré distortions alongside other realworld challenges, such as compression, sharpening, and blurring. By introducing the DMF dataset, we aim to drive future research toward closing the gap between controlled experiments and practical deepfake detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。