为动态GIF图像设计防伪水印,抵御深度伪造攻击
GIFGuard: Proactive Forensics against Deepfakes in Facial GIFs via Spatiotemporal Watermarking
- 采用时空自适应残差编码器,捕捉帧间连贯性特征
- 在严重人脸篡改下仍能准确提取水印信号,鲁棒性强
- 首个GIF防伪基准数据集,适合多媒体安全研究者
深度伪造技术的快速发展对社交网络中代表短循环时序媒体的GIF图像真实性构成前所未有的威胁。现有主动取证方法针对静态图像设计,难以适用于动画GIF。为此,我们提出GIFGuard,首个专为GIF深度伪造主动取证设计的时空水印框架。嵌入阶段,提出时空自适应残差编码器(STARE),采用3D卷积主干与自适应通道重校准,捕获全局一致的时序依赖关系。提取阶段,设计深度完整性恢复解码器(DIRD),利用时空小时钟架构与3D注意力机制恢复潜在特征,实现严重面部篡改下水印信号的精准提取。此外,构建了GIFfaces,首个面向GIF主动取证的大规模基准数据集,推动该领域研究。大量实验表明,GIFGuard在视觉保真度和对抗深度伪造的鲁棒性方面表现卓越。相关代码与数据集已开源。
原文摘要 · Abstract (English)
The rapid evolution of deepfake technology poses an unprecedented threat to the authenticity of Graphics Interchange Format (GIF) imagery, which serves as a representative of short-loop temporal media in social networks. However, existing proactive forensics works are designed for static images, which limits their applicability to animated GIFs. To bridge this gap, we propose GIFGuard, the first spatiotemporal watermarking framework tailored for deepfake proactive forensics in GIFs. In the embedding stage, we propose the Spatiotemporal Adaptive Residual Encoder (STARE) to ensure robustness against high-level semantic tampering. It employs a 3D convolutional backbone with adaptive channel recalibration to capture globally coherent temporal dependencies. In the extraction stage, we design the Deep Integrity Restoration Decoder (DIRD). It utilizes a spatiotemporal hourglass architecture equipped with 3D attention to restore latent features, allowing for the accurate extraction of watermark signals even under severe facial manipulation. Furthermore, we construct GIFfaces, the first large-scale benchmark dataset curated for GIF proactive forensics to facilitate research in this domain. Extensive results show that GIFGuard achieves high-fidelity visual quality and remarkable robustness performance against deepfakes. The related code and dataset are available at https://github.com/vpsg-research/GIFGuard.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。