arXiv:2503.21824cs.CVcs.CR2025-03CVPR被引 5

用隐形干扰水印保护视频,防大模型自动标注泄露隐私。

Protecting Your Video Content: Disrupting Automated Video-based LLM Annotations

  • 设计两类隐形水印:乱言(误导生成错误描述)和静音(强制简短无信息描述)
  • 在多个视频大模型上测试,显著降低自动标注准确率
  • 适合关注视频隐私、需防止数据被滥用的用户

近期,基于视频的大语言模型在各类视频理解任务中表现优异。然而,这一进展带来了严重的隐私与安全问题,尤其是个人视频数据在未经许可的情况下被用于自动化标注。这些未经授权的视频-文本配对可被用来提升下游任务性能,如文生视频生成。为保护个人视频免遭滥用,本文提出两种带有不可察觉对抗扰动的防护水印方案:Ramblings 和 Mutes。Ramblings 旨在误导视频大模型生成与内容不符的错误描述,从而通过内容与描述不一致降低标注质量;Mutes 则促使模型生成极度简略的描述,缺乏关键细节。大量实验表明,所提水印方法能有效保护视频数据,在多个视频大模型上显著降低视频标注性能,同时具备隐蔽性与鲁棒性。代码已公开于 https://github.com/ttthhl/Protecting_Your_Video_Content。

原文摘要 · Abstract (English)

Recently, video-based large language models (video-based LLMs) have achieved impressive performance across various video comprehension tasks. However, this rapid advancement raises significant privacy and security concerns, particularly regarding the unauthorized use of personal video data in automated annotation by video-based LLMs. These unauthorized annotated video-text pairs can then be used to improve the performance of downstream tasks, such as text-to-video generation. To safeguard personal videos from unauthorized use, we propose two series of protective video watermarks with imperceptible adversarial perturbations, named Ramblings and Mutes. Concretely, Ramblings aim to mislead video-based LLMs into generating inaccurate captions for the videos, thereby degrading the quality of video annotations through inconsistencies between video content and captions. Mutes, on the other hand, are designed to prompt video-based LLMs to produce exceptionally brief captions, lacking descriptive detail. Extensive experiments demonstrate that our video watermarking methods effectively protect video data by significantly reducing video annotation performance across various video-based LLMs, showcasing both stealthiness and robustness in protecting personal video content. Our code is available at https://github.com/ttthhl/Protecting_Your_Video_Content.

视频隐私水印技术大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。