arXiv:2505.08437cs.CV2025-05中稿 · PRCV 2024被引 3

构建首个大规模人体伪造数据集,推动伪造检测研究。

TT-DF: A Large-Scale Diffusion-Based Dataset and Benchmark for Human Body Forgery Detection

  • 基于扩散模型生成6120段伪造视频,含超137万帧合成图像。
  • 提出TOF-Net模型,通过光流分布差异识别伪造痕迹,性能超越现有方法。
  • 适配视频安全、AI伦理等领域的研究人员与开发者使用。

随着面部深度伪造技术的兴起,相关数据集与检测方法得到快速发展,缓解了面部人工智能的安全隐患。然而,人体伪造领域因生成技术起步晚、复杂度高,长期缺乏数据集与检测手段。为此,本文提出 TikTok-DeepFake(TT-DF),一个大规模基于扩散模型的数据集,包含6,120段伪造视频和1,378,857帧合成图像,涵盖多种先进人体图像动画模型、基于身份与姿态解耦的两种生成配置及不同压缩版本,旨在全面模拟真实世界中可能出现的未见伪造数据。同时,我们构建了基于该数据集的基准测试,并提出改进的体域伪造检测模型——时序光流网络(TOF-Net),利用自然数据与伪造数据在时空不一致性及光流分布上的差异进行识别。实验表明,TOF-Net在TT-DF上表现优异,优于当前可扩展的面部伪造检测模型。

原文摘要 · Abstract (English)

The emergence and popularity of facial deepfake methods spur the vigorous development of deepfake datasets and facial forgery detection, which to some extent alleviates the security concerns about facial-related artificial intelligence technologies. However, when it comes to human body forgery, there has been a persistent lack of datasets and detection methods, due to the later inception and complexity of human body generation methods. To mitigate this issue, we introduce TikTok-DeepFake (TT-DF), a novel large-scale diffusion-based dataset containing 6,120 forged videos with 1,378,857 synthetic frames, specifically tailored for body forgery detection. TT-DF offers a wide variety of forgery methods, involving multiple advanced human image animation models utilized for manipulation, two generative configurations based on the disentanglement of identity and pose information, as well as different compressed versions. The aim is to simulate any potential unseen forged data in the wild as comprehensively as possible, and we also furnish a benchmark on TT-DF. Additionally, we propose an adapted body forgery detection model, Temporal Optical Flow Network (TOF-Net), which exploits the spatiotemporal inconsistencies and optical flow distribution differences between natural data and forged data. Our experiments demonstrate that TOF-Net achieves favorable performance on TT-DF, outperforming current state-of-the-art extendable facial forgery detection models. For our TT-DF dataset, please refer to https://github.com/HashTAG00002/TT-DF.

人体伪造数据集检测模型扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。