arXiv:2511.07365cs.LGstat.ML2025-11

用隐私保护的压缩数据快照替代敏感数据,实现安全高效的线性回归。

Private Sketches for Linear Regression

  • 通过构造隐私快照替代原始数据,用小规模压缩数据求解回归问题。
  • 在保证差分隐私的前提下,推导出正则化参数的边界值以确保隐私安全。
  • 适合需要处理敏感数据且希望使用通用求解器的研究者和工程师。

线性回归广泛应用于多个领域,其中一些可能包含敏感信息。为此,已有差分隐私(DP)线性回归方法用于生成私有解,通常通过添加噪声来获得解向量的隐私版本。本文提出一种新思路:不直接发布私有解,而是发布数据的私有快照,再基于这些快照进行回归求解。该方法基于“快照-求解”范式,即在数据的压缩表示上求解回归问题,其解仍能保持对原问题的良好近似。我们为最小二乘回归和最小绝对偏差回归构建了差分隐私快照,并证明隐私约束导致正则化回归形式。我们推导了满足隐私要求所需的正则化参数边界。这些私有快照可被现有标准求解器安全使用,避免隐私泄露风险。

原文摘要 · Abstract (English)

Linear regression is frequently applied in a variety of domains, some of which might contain sensitive information. This necessitates that the application of these methods does not reveal private information. Differentially private (DP) linear regression methods, developed for this purpose, compute private estimates of the solution. These techniques typically involve computing a noisy version of the solution vector. Instead, we propose releasing private sketches of the datasets, which can then be used to compute an approximate solution to the regression problem. This is motivated by the \emph{sketch-and-solve} paradigm, where the regression problem is solved on a smaller sketch of the dataset instead of on the original problem space. The solution obtained on the sketch can also be shown to have good approximation guarantees to the original problem. Various sketching methods have been developed for improving the computational efficiency of linear regression problems under this paradigm. We adopt this paradigm for the purpose of releasing private sketches of the data. We construct differentially private sketches for the problems of least squares regression, as well as least absolute deviations regression. We show that the privacy constraints lead to sketched versions of regularized regression. We compute the bounds on the regularization parameter required for guaranteeing privacy. The availability of these private sketches facilitates the application of commonly available solvers for regression, without the risk of privacy leakage.

差分隐私线性回归数据压缩正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。