用随机投影实现隐私保护下的精准变量选择
Differentially Private Model-X Knockoffs via Johnson-Lindenstrauss Transform
- 通过高斯约翰逊-林德斯特拉姆变换保护数据隐私
- 在严格隐私约束下仍保持变量选择的统计功效
- 适合敏感数据场景中的可靠特征筛选
我们提出一种新型隐私化框架,用于高维受控变量选择。该框架在差分隐私约束下实现严格的错误发现率(FDR)控制。虽然Model-X knockoff方法通过构建可证明交换的“负向对照”特征提供FDR保障,但现有隐私机制如拉普拉斯或高斯噪声注入会破坏其核心交换性条件。我们的关键创新在于利用高斯约翰逊-林德斯特拉姆变换(JLT)对数据knockoff矩阵进行隐私化处理,这是一种维度约简技术,通过近似等距性同时保持协变量关系,实现(ε,δ)-差分隐私。我们理论分析了所提私有变量选择方法的FDR与统计功效,在渐近情形下刻画了维度压缩比、信噪比、差分隐私参数、样本量和特征维度等因素对隐私-功效权衡的影响。分析基于一种针对高维私有knockoff方法的新型去偏技术,并进一步建立了功率收敛至1的充分条件。本工作连接了基于knockoff的FDR控制与私有数据发布两大范式,使敏感领域中的可靠变量选择成为可能。分析表明,通过随机投影实现的结构化隐私保护优于传统噪声添加机制,在严苛隐私预算下仍能维持较高统计功效。
原文摘要 · Abstract (English)
We introduce a novel privatization framework for high-dimensional controlled variable selection. Our framework enables rigorous False Discovery Rate (FDR) control under differential privacy constraints. While the Model-X knockoff procedure provides FDR guarantees by constructing provably exchangeable ``negative control" features, existing privacy mechanisms like Laplace or Gaussian noise injection disrupt its core exchangeability conditions. Our key innovation lies in privatizing the data knockoff matrix through the Gaussian Johnson-Lindenstrauss Transformation (JLT), a dimension reduction technique that simultaneously preserves covariate relationships through approximate isometry for $(ε,δ)$-differential privacy. We theoretically characterize both FDR and the power of the proposed private variable selection procedure, in an asymptotic regime. Our theoretical analysis characterizes the role of different factors, such as the JLT's dimension reduction ratio, signal-to-noise ratio, differential privacy parameters, sample size and feature dimension, in shaping the privacy-power trade-off. Our analysis is based on a novel `debiasing technique' for high-dimensional private knockoff procedure. We further establish sufficient conditions under which the power of the proposed procedure converges to one. This work bridges two critical paradigms -- knockoff-based FDR control and private data release -- enabling reliable variable selection in sensitive domains. Our analysis demonstrates that structural privacy preservation through random projections outperforms the classical noise addition mechanism, maintaining statistical power even under strict privacy budgets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。