arXiv:2504.07578cs.CRcs.LG2025-04被引 1

用同态加密与差分隐私实现高效安全的垂直聚类,通信量降低千倍。

Privacy-Preserving Vertical K-Means Clustering

  • 结合同态加密与差分隐私,仅需一次数据外包即可完成聚类计算。
  • 10万二维点聚成5类仅需73MB通信,比现有方法减少99.3%。
  • 适用于跨网络部署,准确率接近明文算法,适合多方数据协作场景。

聚类是基于一个或多个特征对记录进行分组的基础数据处理任务。在垂直划分场景下,数据由多个参与方分散持有,每个方仅掌握部分特征。此时计算记录间距离需访问全部特征,而这些特征可能涉及隐私,无法直接共享。目标是在保护各方数据隐私的前提下完成联合聚类。现有基于秘密共享或混淆电路的方法虽可实现隐私保护的Lloyd算法,但通信开销高,随数据点数n、聚类数k和轮次t呈O(nkt)增长,仅适用于局域网环境。另一类方法依赖差分隐私(DP)将本地特征外包至中心服务器,但因加噪过多导致聚类效果严重下降。本文提出一种新方案,结合同态加密与差分隐私,将通信复杂度降至O(n+kt)。各参与方一次性安全上传特征,计算方可在加密状态下执行聚类操作;仅对聚类中心施加差分隐私,确保隐私且对性能影响最小。实验显示,对10万条二维数据聚成5类,通信量仅73MB,相较现有方法的101GB大幅降低;在100Mbps网络下耗时不足3分钟,而现有方法需超1天。本方案适用于广域网部署,且聚类精度接近明文k均值算法。

原文摘要 · Abstract (English)

Clustering is a fundamental data processing task used for grouping records based on one or more features. In the vertically partitioned setting, data is distributed among entities, with each holding only a subset of those features. A key challenge in this scenario is that computing distances between records requires access to all distributed features, which may be privacy-sensitive and cannot be directly shared with other parties. The goal is to compute the joint clusters while preserving the privacy of each entity's dataset. Existing solutions using secret sharing or garbled circuits implement privacy-preserving variants of Lloyd's algorithm but incur high communication costs, scaling as O(nkt), where n is the number of data points, k the number of clusters, and t the number of rounds. These methods become impractical for large datasets or several parties, limiting their use to LAN settings only. On the other hand, a different line of solutions rely on differential privacy (DP) to outsource the local features of the parties to a central server. However, they often significantly degrade the utility of the clustering outcome due to excessive noise. In this work, we propose a novel solution based on homomorphic encryption and DP, reducing communication complexity to O(n+kt). In our method, parties securely outsource their features once, allowing a computing party to perform clustering operations under encryption. DP is applied only to the clusters' centroids, ensuring privacy with minimal impact on utility. Our solution clusters 100,000 two-dimensional points into five clusters using only 73MB of communication, compared to 101GB for existing works, and completes in just under 3 minutes on a 100Mbps network, whereas existing works take over 1 day. This makes our solution practical even for WAN deployments, all while maintaining accuracy comparable to plaintext k-means algorithms.

隐私计算聚类同态加密差分隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。