arXiv:2601.22625stat.MLcs.LG2026-01被引 2

提出新方法在回归任务中实现标签差分隐私,无需离散化提升精度。

RPWithPrior: Label Differential Privacy in Regression

  • 将原始与随机响应建模为连续变量,避免离散化操作。
  • 在多个真实数据集上优于高斯、拉普拉斯等现有方法。
  • 适用于有/无先验信息的场景,适合隐私敏感回归应用。

随着机器学习在实际中的广泛应用,隐私保护日益受到关注。在数据挖掘与分析领域,如何在最小化精度损失的前提下保护用户隐私是一项基本任务。本文聚焦于在ε-标签差分隐私保证下的回归任务。现有方法如RR-On-Bins通过将输出空间划分为有限区间并应用随机响应(RR)算法来实现隐私保护,但需将原始响应向下取整至整数,与现实场景不符。为此,我们创新性地将原始响应与随机响应均建模为连续随机变量,完全避免了离散化。所提方法估计最优随机响应区间,并设计了在先验已知或未知情况下的新算法。理论上证明了所提算法RPWithPrior满足ε-标签差分隐私。数值实验表明,在Communities and Crime、Criteo Sponsored Search Conversion Log、California Housing数据集上,该方法性能优于高斯、拉普拉斯、阶梯函数及RRonBins、无偏机制。

原文摘要 · Abstract (English)

With the wide application of machine learning techniques in practice, privacy preservation has gained increasing attention. Protecting user privacy with minimal accuracy loss is a fundamental task in the data analysis and mining community. In this paper, we focus on regression tasks under $ε$-label differential privacy guarantees. Some existing methods for regression with $ε$-label differential privacy, such as the RR-On-Bins mechanism, discretized the output space into finite bins and then applied RR algorithm. To efficiently determine these finite bins, the authors rounded the original responses down to integer values. However, such operations does not align well with real-world scenarios. To overcome these limitations, we model both original and randomized responses as continuous random variables, avoiding discretization entirely. Our novel approach estimates an optimal interval for randomized responses and introduces new algorithms designed for scenarios where a prior is either known or unknown. Additionally, we prove that our algorithm, RPWithPrior, guarantees $ε$-label differential privacy. Numerical results demonstrate that our approach gets better performance compared with the Gaussian, Laplace, Staircase, and RRonBins, Unbiased mechanisms on the Communities and Crime, Criteo Sponsored Search Conversion Log, California Housing datasets.

差分隐私回归分析隐私保护连续建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。