通过几何视角改进指纹码下界,优化差分隐私查询分析的样本复杂度
Fingerprinting Codes Meet Geometry: Improved Lower Bounds for Private Query Release and Adaptive Data Analysis
- 构建几何适配的指纹码框架,针对查询集结构定制下界证明
- 首个匹配上界的结果:自适应计数查询需Ω(√log|X|·logQ/α³)样本
- 适用于高精度差分隐私场景,适合研究隐私算法极限的研究者
指纹码是证明差分隐私下界的关键工具,尤其在低精度情形中表现优异。本文提出一种通用框架,可依据查询集的几何特性定制指纹码下界证明。该方法首次实现对任意自适应计数查询的紧致下界:任何在样本和总体上准确的算法,回答 $Q$ 个查询至精度 $α$ 需 $Ω(\frac{\sqrt{\log |\mathcal{X}|} \cdot \log Q}{α^3})$ 样本,与已知上界匹配。同时,对于 $(\varepsilon,δ)$-差分隐私算法,所需样本量为 $Ω(\frac{\sqrt{ \log|\mathcal{X}| \log(1/δ)} \log Q}{\varepsilon α^2})$,较之前结果提升 $\sqrt{\log(1/δ)}$。此外,完整刻画了随机 0-1 查询在近似差分隐私下的样本复杂度,在不同区间给出新上下界。
原文摘要 · Abstract (English)
Fingerprinting codes are a crucial tool for proving lower bounds in differential privacy. They have been used to prove tight lower bounds for several fundamental questions, especially in the ``low accuracy'' regime. Unlike reconstruction/discrepancy approaches however, they are more suited for query sets that arise naturally from the fingerprinting codes construction. In this work, we propose a general framework for proving fingerprinting type lower bounds, that allows us to tailor the technique to the geometry of the query set. Our approach allows us to prove several new results, including the following. First, we show that any (sample- and population-)accurate algorithm for answering $Q$ arbitrary adaptive counting queries over a universe $\mathcal{X}$ to accuracy $α$ needs $Ω(\frac{\sqrt{\log |\mathcal{X}|}\cdot \log Q}{α^3})$ samples, matching known upper bounds. This shows that the approaches based on differential privacy are optimal for this question, and improves significantly on the previously known lower bounds of $\frac{\log Q}{α^2}$ and $\min(\sqrt{Q}, \sqrt{\log |\mathcal{X}|})/α^2$. Second, we show that any $(\varepsilon,δ)$-DP algorithm for answering $Q$ counting queries to accuracy $α$ needs $Ω(\frac{\sqrt{ \log|\mathcal{X}| \log(1/δ)} \log Q}{\varepsilonα^2})$ samples, matching known upper bounds up to constants. Our framework allows for proving this bound via a direct correlation analysis and improves the prior bound of [BUV'14] by $\sqrt{\log(1/δ)}$. Third, we characterize the sample complexity of answering a set of random $0$-$1$ queries under approximate differential privacy. We give new upper and lower bounds in different regimes. By combining them with known results, we can complete the whole picture.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。