arXiv:2506.15201cs.CV2025-06ICML

图像压缩阶段加防护,防止视觉语言模型窃取隐私信息。

Privacy-Shielded Image Compression: Defending Against Exploitation from Vision-Language Pretrained Models

  • 在压缩时生成多解码版本的比特流,可选保护语义或保留完整信息。
  • 通过条件隐变量生成器实现定制化解码,支持隐私保护与信息还原双模式。
  • 兼容主流学习型图像压缩模型,适合需防数据滥用的图像发布场景。

视觉语言预训练(VLP)模型的语义理解能力提升,使公开发布的图像越来越容易被搜索引擎等工具利用。本文提出一种灵活的编码方法——隐私屏蔽图像压缩(PSIC),可在压缩阶段实现隐私防护。该方法生成具有多种解码选项的比特流:默认情况下,解码后图像保持良好感知质量,但无法被VLP模型解析;同时保留原始图像压缩功能。通过自定义输入条件,系统可重构包含完整语义信息的图像。为此设计了条件隐变量触发生成(CLTG)模块,基于条件生成引导解码的偏置信息,并引入不确定性感知加密优化函数(UAEO),利用目标VLP模型对训练数据的不确定预测软标签进行优化。进一步采用自适应多目标优化策略,在统一训练过程中同时提升加密效果与感知质量。该方案即插即用,可无缝集成至多数现有学习型图像压缩(LIC)模型中。跨多个下游任务的大量实验验证了其有效性。

原文摘要 · Abstract (English)

The improved semantic understanding of vision-language pretrained (VLP) models has made it increasingly difficult to protect publicly posted images from being exploited by search engines and other similar tools. In this context, this paper seeks to protect users' privacy by implementing defenses at the image compression stage to prevent exploitation. Specifically, we propose a flexible coding method, termed Privacy-Shielded Image Compression (PSIC), that can produce bitstreams with multiple decoding options. By default, the bitstream is decoded to preserve satisfactory perceptual quality while preventing interpretation by VLP models. Our method also retains the original image compression functionality. With a customizable input condition, the proposed scheme can reconstruct the image that preserves its full semantic information. A Conditional Latent Trigger Generation (CLTG) module is proposed to produce bias information based on customizable conditions to guide the decoding process into different reconstructed versions, and an Uncertainty-Aware Encryption-Oriented (UAEO) optimization function is designed to leverage the soft labels inferred from the target VLP model's uncertainty on the training data. This paper further incorporates an adaptive multi-objective optimization strategy to obtain improved encrypting performance and perceptual quality simultaneously within a unified training process. The proposed scheme is plug-and-play and can be seamlessly integrated into most existing Learned Image Compression (LIC) models. Extensive experiments across multiple downstream tasks have demonstrated the effectiveness of our design.

隐私保护图像压缩VLP模型安全编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。