arXiv:2601.06368cs.CRcs.CV2026-01中稿 · Usenix Security 20…被引 3

通过频域与空间特征结合,提升私密图像生成质量。

From Easy to Hard++: Promoting Differentially Private Image Synthesis Through Spatial-Frequency Curriculum

  • 引入频域特征作为训练捷径,实现更精细的私密训练课程。
  • 在ε=1隐私预算下,生成图像保真度提升25.7%,效用增4.1%。
  • 适合关注隐私保护图像生成的研究者与应用开发者。

为提升差分隐私(DP)合成图像的质量,现有研究多聚焦于核心优化技术(如DP-SGD)。近期趋势转向将这些技术组合使用以获得最佳效果。受DP-FETA启发,我们探索是否可与其他工具协同使用。观察发现,使用‘中心图像’仅适用于样本相似性高的数据集。针对图像差异大的场景,提出FETA-Pro,引入频率特征作为‘训练捷径’。频率特征复杂度介于空间特征(由‘中心图像’捕获)与全图之间,支持更细粒度的私密训练课程。为解决空间与频率特征间的训练偏差,利用生成模型的流水线生成特性——不采用单一模型多任务训练,而是构建多模型协作:先用辅助生成器基于噪声频率特征生成图像,再用该结果联合空间特征与DP-SGD训练主模型。在五个敏感图像数据集上评估,FETA-Pro在ε=1隐私预算下,平均保真度提升25.7%,效用提升4.1%,优于最优基线。

原文摘要 · Abstract (English)

To improve the quality of Differentially private (DP) synthetic images, most studies have focused on improving the core optimization techniques (e.g., DP-SGD). Recently, we have witnessed a paradigm shift that takes these techniques off the shelf and studies how to use them together to achieve the best results. One notable work is DP-FETA, which proposes using `central images' for `warming up' the DP training and then using traditional DP-SGD. Inspired by DP-FETA, we are curious whether there are other such tools we can use together with DP-SGD. We first observe that using `central images' mainly works for datasets where there are many samples that look similar. To handle scenarios where images could vary significantly, we propose FETA-Pro, which introduces frequency features as `training shortcuts.' The complexity of frequency features lies between that of spatial features (captured by `central images') and full images, allowing for a finer-grained curriculum for DP training. To incorporate these two types of shortcuts together, one challenge is to handle the training discrepancy between spatial and frequency features. To address it, we leverage the pipeline generation property of generative models (instead of having one model trained with multiple features/objectives, we can have multiple models working on different features, then feed the generated results from one model into another) and use a more flexible design. Specifically, FETA-Pro introduces an auxiliary generator to produce images aligned with noisy frequency features. Then, another model is trained with these images, together with spatial features and DP-SGD. Evaluated across five sensitive image datasets, FETA-Pro shows an average of 25.7% higher fidelity and 4.1% greater utility than the best-performing baseline, under a privacy budget $ε= 1$.

差分隐私图像生成频域特征训练课程

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。