多方协作训练隐私保护的乘积和网络,性能不降且可扩展。
N-Parties Private Structure and Parameter Learning for Sum-Product Networks
- 基于秘密共享构建多方隐私协议,支持结构生成与参数学习。
- 在同质与异质数据划分下,隐私保护不影响对数似然性能。
- 适用于需要数据隐私的多方机器学习场景,如医疗或金融建模。
乘积和网络(SPN)是一种图模型,可高效执行多种概率推断。本文提出一种隐私保护协议,用于处理SPN的结构生成与参数学习,并提供训练后私有推断的方案。为保障参与者隐私,协议基于秘密共享设计,在诚实但好奇的威胁模型下,即使最多一半参与方合谋也无法泄露数据。协议使用随机生成的SPN森林,通过私有方式训练并加权,随后可用于对数据点进行私有推断。实验表明,所有参与方隐私保护不会降低同质与异质划分数据上的对数似然表现;在同质数据设置下,本协议性能接近当前最优SPN学习器。在运行时间和内存占用方面,随着参与方数量增加,本实现表现出良好可扩展性,优于同类神经网络协议在拟合SPN输入输出行为时的表现。
原文摘要 · Abstract (English)
A sum-product network (SPN) is a graphical model that allows several types of probabilistic inference to be performed efficiently. In this paper, we propose a privacy-preserving protocol which tackles structure generation and parameter learning of SPNs. Additionally, we provide a protocol for private inference on SPNs, subsequent to training. To preserve the privacy of the participants, we derive our protocol based on secret sharing, which guarantees privacy in the honest-but-curious setting even when at most half of the parties cooperate to disclose the data. The protocol makes use of a forest of randomly generated SPNs, which is trained and weighted privately and can then be used for private inference on data points. Our experiments indicate that preserving the privacy of all participants does not decrease log-likelihood performance on both homogeneously and heterogeneously partitioned data. We furthermore show that our protocol's performance is comparable to current state-of-the-art SPN learners in homogeneously partitioned data settings. In terms of runtime and memory usage, we demonstrate that our implementation scales well when increasing the number of parties, comparing favorably to protocols for neural networks, when they are trained to reproduce the input-output behavior of SPNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。