arXiv:2412.10512cs.CRcs.DS2024-12被引 3

提出隐私保护多样本生成新方法,效率比传统方式高得多。

Differentially Private Multi-Sampling from Distributions

  • 设计改进的差分隐私机制,实现更高效的多样本生成。
  • 在有限域数据上,样本复杂度提升至基线的1/m,显著节省资源。
  • 适用于需要合成数据的探索性分析场景,如隐私敏感数据分析。

许多算法被用于在差分隐私(DP)约束下估计概率分布:这类算法接收来自分布的独立样本,并以对任一样本不敏感的方式估计密度函数。最近的研究由Raskhodnikova等人(NeurIPS '21)开启,探索了较弱的目标:一个能够近似从分布中生成单个样本的差分隐私算法。他们研究了差分隐私单样本生成的样本复杂度,即完成该任务所需的最少样本数,并发现对于某些分布类,其复杂度低于差分隐私学习。本文定义了两种多样本生成变体,目标是私密地近似生成m>1个样本,这更贴近真实场景中需要合成数据进行探索性分析的需求。基线方法是将单样本生成算法在独立数据集上运行m次;当数据来自有限域时,我们通过新方法使样本复杂度比基线提升m倍。当数据为高斯分布且协方差已知时,Ghazi等人(NeurIPS '23)证明可在近似差分隐私下实现单样本生成;我们进一步证明在纯差分隐私下可实现单样本与多样本生成。我们的解决方案采用一种具有独立意义的拉普拉斯机制变体。此外,我们还给出了两个样本复杂度下界:一个针对有限分布的强多样本生成,另一个针对有界协方差高斯分布的弱多样本生成。

原文摘要 · Abstract (English)

Many algorithms have been developed to estimate probability distributions subject to differential privacy (DP): such an algorithm takes as input independent samples from a distribution and estimates the density function in a way that is insensitive to any one sample. A recent line of work, initiated by Raskhodnikova et al. (Neurips '21), explores a weaker objective: a differentially private algorithm that approximates a single sample from the distribution. Raskhodnikova et al. studied the sample complexity of DP \emph{single-sampling} i.e., the minimum number of samples needed to perform this task. They showed that the sample complexity of DP single-sampling is less than the sample complexity of DP learning for certain distribution classes. We define two variants of \emph{multi-sampling}, where the goal is to privately approximate $m>1$ samples. This better models the realistic scenario where synthetic data is needed for exploratory data analysis. A baseline solution to \emph{multi-sampling} is to invoke a single-sampling algorithm $m$ times on independently drawn datasets of samples. When the data comes from a finite domain, we improve over the baseline by a factor of $m$ in the sample complexity. When the data comes from a Gaussian, Ghazi et al. (Neurips '23) show that \emph{single-sampling} can be performed under approximate differential privacy; we show it is possible to \emph{single- and multi-sample Gaussians with known covariance subject to pure DP}. Our solution uses a variant of the Laplace mechanism that is of independent interest. We also give sample complexity lower bounds, one for strong multi-sampling of finite distributions and another for weak multi-sampling of bounded-covariance Gaussians.

差分隐私多样本生成高斯分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。