arXiv:2506.07555cs.CVcs.AI2025-06NeurIPS被引 7

用私有文本中间表示生成高分辨率隐私图像,效果远超传统方法。

Synthesize Privacy-Preserving High-Resolution Images via Private Textual Intermediaries

  • 将隐私保护图像生成从图像域转至文本域,利用现有私有文本生成技术
  • 在LSUN Bedroom上达FID 26.71(ε=1.0),优于基线40.36
  • 无需训练,仅需调用现成模型,适合无训练资源的场景

生成高保真、差分隐私(DP)的合成图像为共享和分析敏感视觉数据提供了可行路径。然而,现有DP图像生成方法难以产出高质量高分辨率图像。本文提出一种新方法——通过私有文本中间表示生成图像(SPTI),可轻松生成高分辨率DP图像。核心思路是将DP图像生成挑战转移到文本域,借助先进的DP文本生成方法。SPTI首先用图文模型将每张私有图像压缩为简洁文本描述,再使用改进的私有演化算法生成差分隐私文本,最后通过文生图模型重建图像。该方法无需模型训练,仅依赖现成模型推理。在私有数据集上,SPTI生成图像质量显著优于以往方法:在LSUN Bedroom数据集上,ε=1.0时FID达26.71,优于私有演化法的40.36;在MM CelebA HQ上,FID为33.27,优于DP微调基线的57.01。结果表明,SPTI提供了一种资源高效且兼容私有模型的高分辨率DP图像生成框架,极大拓展了对私有视觉数据集的访问能力。

原文摘要 · Abstract (English)

Generating high fidelity, differentially private (DP) synthetic images offers a promising route to share and analyze sensitive visual data without compromising individual privacy. However, existing DP image synthesis methods struggle to produce high resolution outputs that faithfully capture the structure of the original data. In this paper, we introduce a novel method, referred to as Synthesis via Private Textual Intermediaries (SPTI), that can generate high resolution DP images with easy adoption. The key idea is to shift the challenge of DP image synthesis from the image domain to the text domain by leveraging state of the art DP text generation methods. SPTI first summarizes each private image into a concise textual description using image to text models, then applies a modified Private Evolution algorithm to generate DP text, and finally reconstructs images using text to image models. Notably, SPTI requires no model training, only inference with off the shelf models. Given a private dataset, SPTI produces synthetic images of substantially higher quality than prior DP approaches. On the LSUN Bedroom dataset, SPTI attains an FID equal to 26.71 under epsilon equal to 1.0, improving over Private Evolution FID of 40.36. Similarly, on MM CelebA HQ, SPTI achieves an FID equal to 33.27 at epsilon equal to 1.0, compared to 57.01 from DP fine tuning baselines. Overall, our results demonstrate that Synthesis via Private Textual Intermediaries provides a resource efficient and proprietary model compatible framework for generating high resolution DP synthetic images, greatly expanding access to private visual datasets.

隐私生成差分隐私文生图高分辨率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。