arXiv:2504.06923cs.CRcs.LG2025-04被引 7

优化离散化策略可显著提升隐私合成数据的实用性和安全性。

The Importance of Being Discrete: Measuring the Impact of Discretization in End-to-End Differentially Private Synthetic Data

  • 设计了三种差分隐私化的离散化方法,改进了默认策略。
  • 优化后平均提升30%实用性,PrivTree表现最佳。
  • 在隐私保护与计算效率间取得更好平衡,适合数据发布场景。

差分隐私(DP)生成边际模型常用于发布敏感表格数据的合成版本,以提供正式隐私保障。这些模型近似低维边际或查询负载,关键在于训练数据需预先离散化,即连续值需先划分成区间。然而,由于值域通常从训练数据中直接推断,区间数量和边界常任意设定,这可能破坏端到端的差分隐私保证,且未必带来最优效用。本文针对四种离散化策略开展广泛测量研究,设计了三种离散化器(均匀、分位数、k均值)的差分隐私版本,并重新实现PrivTree算法。结果表明,优化离散化器选择和区间数量,可在六个DP边际模型上平均提升约30%的效用,优于默认策略;多数情况下PrivTree表现最优。我们还发现,若离散化过程不加隐私保护,生成模型仍易受成员推断攻击;而将差分隐私应用于离散化阶段,能有效缓解该风险。最后,我们改进了一种自动选择最优区间数的方法,在降低隐私预算消耗和计算开销的同时,保持高效用。

原文摘要 · Abstract (English)

Differentially Private (DP) generative marginal models are often used in the wild to release synthetic tabular datasets in lieu of sensitive data while providing formal privacy guarantees. These models approximate low-dimensional marginals or query workloads; crucially, they require the training data to be pre-discretized, i.e., continuous values need to first be partitioned into bins. However, as the range of values (or their domain) is often inferred directly from the training data, with the number of bins and bin edges typically defined arbitrarily, this approach can ultimately break end-to-end DP guarantees and may not always yield optimal utility. In this paper, we present an extensive measurement study of four discretization strategies in the context of DP marginal generative models. More precisely, we design DP versions of three discretizers (uniform, quantile, and k-means) and reimplement the PrivTree algorithm. We find that optimizing both the choice of discretizer and bin count can improve utility, on average, by almost 30% across six DP marginal models, compared to the default strategy and number of bins, with PrivTree being the best-performing discretizer in the majority of cases. We demonstrate that, while DP generative models with non-private discretization remain vulnerable to membership inference attacks, applying DP during discretization effectively mitigates this risk. Finally, we improve on an existing approach for automatically selecting the optimal number of bins, and achieve high utility while reducing both privacy budget consumption and computational overhead.

差分隐私数据合成离散化效用优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。