arXiv:2502.16519cs.LGcs.PL2025-02

通过精准识别无需加噪的输入,实现高精度隐私保护的标签访问。

Guarding the Privacy of Label-Only Access to Neural Network Classifiers via iDP Verification

  • 构建iDP确定性边界,仅对不满足条件的输入加噪。
  • 在保持98.6%准确率下实现0-iDP隐私保护,降幅仅1.4%。
  • 适合需极致隐私保护且容忍微小精度损失的场景。

神经网络易受隐私攻击,泄露训练数据信息。传统差分隐私(DP)需对所有可能训练集加噪,导致性能显著下降。个体差分隐私(iDP)仅针对特定训练集定义,我们发现部分输入可无噪声满足iDP。为此提出LUCID方法:将问题建模为混合整数线性规划,利用超网络抽象多模型,结合新型分支定界法消除过近似误差,并通过线性松弛处理相似神经元差异。实验表明,LUCID可在准确率仅下降1.4%的前提下实现0-iDP(完美个体隐私),而现有DP训练算法精度下降达12.7%;对于ε-iDP,准确率下降仅1.2%。

原文摘要 · Abstract (English)

Neural networks are susceptible to privacy attacks that can extract private information of the training set. To cope, several training algorithms guarantee differential privacy (DP) by adding noise to their computation. However, DP requires to add noise considering every possible training set. This leads to a significant decrease in the network's accuracy. Individual DP (iDP) restricts DP to a given training set. We observe that some inputs deterministically satisfy iDP without any noise. By identifying them, we can provide iDP label-only access to the network with a minor decrease to its accuracy. However, identifying the inputs that satisfy iDP without any noise is highly challenging. Our key idea is to compute the iDP deterministic bound (iDP-DB), which overapproximates the set of inputs that do not satisfy iDP, and add noise only to their predicted labels. To compute the tightest iDP-DB, which enables to guard the label-only access with minimal accuracy decrease, we propose LUCID, which leverages several formal verification techniques. First, it encodes the problem as a mixed-integer linear program, defined over a network and over every network trained identically but without a unique data point. Second, it abstracts a set of networks using a hyper-network. Third, it eliminates the overapproximation error via a novel branch-and-bound technique. Fourth, it bounds the differences of matching neurons in the network and the hyper-network and employs linear relaxation if they are small. We show that LUCID can provide classifiers with a perfect individuals' privacy guarantee (0-iDP) -- which is infeasible for DP training algorithms -- with an accuracy decrease of 1.4%. For more relaxed $\varepsilon$-iDP guarantees, LUCID has an accuracy decrease of 1.2%. In contrast, existing DP training algorithms reduce the accuracy by 12.7%.

隐私保护差分隐私模型安全形式验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。