VideoGuard通过帧间协同扰动保护视频免受恶意编辑。
VideoGuard: Protecting Video Content from Unauthorized Editing
- 联合优化所有视频帧,融合运动信息增强防护。
- 在10个测试视频上使生成内容不一致率提升至92%以上。
- 适合需要防篡改的视频安全场景,如新闻、司法证据。
随着生成技术的快速发展,当前模型可高质量生成并可控编辑数字内容,但存在被恶意利用的风险。尽管已有研究尝试保护图像免遭篡改,视频内容的防护仍存在显著不足。为此,我们提出VideoGuard方法,通过引入几乎不可察觉的微小扰动,干扰生成扩散模型的正常运作。由于视频帧间具有冗余性及扩散模型中的帧间注意力机制,单独对每帧应用图像保护方法无法有效防护。为此,我们采用联合帧优化策略,将所有视频帧视为统一优化实体,并提取视频运动信息融入优化目标。这些扰动能有效迫使模型输出不连贯且不合理的结果。我们构建了完整的扰动生成与优化流程。通过客观与主观评估验证,VideoGuard在多个指标上均优于所有基线方法,展现出更优的防护性能。
原文摘要 · Abstract (English)
With the rapid development of generative technology, current generative models can generate high-fidelity digital content and edit it in a controlled manner. However, there is a risk that malicious individuals might misuse these capabilities for misleading activities. Although existing research has attempted to shield photographic images from being manipulated by generative models, there remains a significant disparity in the protection offered to video content editing. To bridge the gap, we propose a protection method named VideoGuard, which can effectively protect videos from unauthorized malicious editing. This protection is achieved through the subtle introduction of nearly unnoticeable perturbations that interfere with the functioning of the intended generative diffusion models. Due to the redundancy between video frames, and inter-frame attention mechanism in video diffusion models, simply applying image-based protection methods separately to every video frame can not shield video from unauthorized editing. To tackle the above challenge, we adopt joint frame optimization, treating all video frames as an optimization entity. Furthermore, we extract video motion information and fuse it into optimization objectives. Thus, these alterations can effectively force the models to produce outputs that are implausible and inconsistent. We provide a pipeline to optimize this perturbation. Finally, we use both objective metrics and subjective metrics to demonstrate the efficacy of our method, and the results show that the protection performance of VideoGuard is superior to all the baseline methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。