arXiv:2510.16974cs.LGstat.ML2025-10被引 1

提出可提供置信区间与可靠合成数据的差分隐私线性回归方法。

Differentially Private Linear Regression and Synthetic Data Generation with Statistical Guarantees

  • 基于高斯差分隐私设计偏差校正估计器与置信区间。
  • 在小到中等维度下,相比现有方法提升回归精度与合成数据质量。
  • 适合社会科学研究中的小规模连续变量数据隐私分析。

在社会科学中,小至中等规模的数据集常见,线性回归是标准方法。当前差分隐私(DP)线性回归研究多聚焦于点估计,对不确定性量化关注不足;而合成数据生成(SDG)对可重复性研究日益重要,但现有DP线性回归方法难以支持。主流DP-SDG方法或仅适用于离散/离散化数据,或依赖需大规模数据的深度学习模型,不适用于社会科学常见的小规模连续变量数据。本文提出一种在高斯差分隐私下实现有效推断的线性回归方法,包含偏差校正估计器与渐近置信区间(CIs),并设计通用的合成数据生成流程,使在合成数据上的回归结果与本方法一致。实验表明,该方法(1)在DP线性回归上优于现有方法,(2)提供有效的置信区间,(3)生成的合成数据在下游统计与机器学习任务中更可靠。

原文摘要 · Abstract (English)

In the social sciences, small- to medium-scale datasets are common, and linear regression is canonical. In privacy-aware settings, much work has focused on differentially private (DP) linear regression, but mostly on point estimation with limited attention to uncertainty quantification. Meanwhile, synthetic data generation (SDG) is increasingly important for reproducibility studies, yet current DP linear regression methods do not readily support it. Mainstream DP-SDG approaches either are tailored to discrete or discretized data, making them less suitable for analyses involving continuous variables, or rely on deep learning models that require large datasets, limiting their use for the smaller-scale data typical in social science. We propose a method for linear regression with valid inference under Gaussian DP. It includes a bias-corrected estimator with asymptotic confidence intervals (CIs) and a general SDG procedure such that the corresponding regression on the synthetic data matches our DP linear regression procedure. Our approach is effective in small- to moderate-dimensional settings. Experiments show that our method (1) improves accuracy over existing methods for DP linear regression, (2) provides valid CIs, and (3) produces more reliable synthetic data for downstream statistical and machine learning tasks than current DP synthesizers.

差分隐私线性回归合成数据统计推断

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。