arXiv:2504.15580cs.DScs.CR2025-04ICLR被引 2

提出新算法,在保护隐私的同时显著降低层次聚类误差。

On the Price of Differential Privacy for Hierarchical Clustering

  • 在边权隐私模型下设计高效算法,实现更优的聚类精度。
  • 达到 O(log¹·⁵n/ε) 的乘法误差,优于传统方法的加法误差上限。
  • 适用于敏感数据聚类,尤其适合大规模图结构数据。

层次聚类是将数据组织成层次化簇的基本无监督学习任务,常涉及敏感用户信息,因此近年来在达斯古普塔目标框架下研究差分隐私层次聚类。然而已有研究表明,边级差分隐私下的任何隐私保护算法必然导致较大误差。为更贴近实际应用,本文聚焦边权隐私模型(即输入图中每条边至少为单位权重),提出一种新算法,其近似性能显著优于边级DP设定中的已知不可能性结果。具体而言,该算法在 ε-差分隐私下达到 O(log¹·⁵n/ε) 的乘法误差,且运行时间多项式,代价不超过现有工作最优加法误差。我们进一步证明:若不满足单位权重约束,则边权级差分隐私层次聚类的下界与边级相同,即 Ω(n²/ε) 加法误差。由此,我们还获得边权级差分隐私下平衡稀疏割问题的新下界 ˜Ω(1/ε)。最后,我们在合成及真实数据集上评估算法,实验表明其额外开销小、可扩展至大规模图。

原文摘要 · Abstract (English)

Hierarchical clustering is a fundamental unsupervised machine learning task with the aim of organizing data into a hierarchy of clusters. Many applications of hierarchical clustering involve sensitive user information, therefore motivating recent studies on differentially private hierarchical clustering under the rigorous framework of Dasgupta's objective. However, it has been shown that any privacy-preserving algorithm under edge-level differential privacy necessarily suffers a large error. To capture practical applications of this problem, we focus on the weight privacy model, where each edge of the input graph is at least unit weight. We present a novel algorithm in the weight privacy model that shows significantly better approximation than known impossibility results in the edge-level DP setting. In particular, our algorithm achieves $O(\log^{1.5}n/\varepsilon)$ multiplicative error for $\varepsilon$-DP and runs in polynomial time, where $n$ is the size of the input graph, and the cost is never worse than the optimal additive error in existing work. We complement our algorithm by showing if the unit-weight constraint does not apply, the lower bound for weight-level DP hierarchical clustering is essentially the same as the edge-level DP, i.e. $Ω(n^2/\varepsilon)$ additive error. As a result, we also obtain a new lower bound of $\tildeΩ(1/\varepsilon)$ additive error for balanced sparsest cuts in the weight-level DP model, which may be of independent interest. Finally, we evaluate our algorithm on synthetic and real-world datasets. Our experimental results show that our algorithm performs well in terms of extra cost and has good scalability to large graphs.

差分隐私层次聚类算法设计图学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。