arXiv:2605.06505cs.LGcs.AI2026-05

通过符号量化实现零阶微调的高隐私保护,零信息泄露下仍保持良好性能。

PACZero: PAC-Private Fine-Tuning of Language Models via Sign Quantization

  • 用符号量化零阶梯度,利用多数一致步骤降低信息泄露。
  • 在I=0条件下,SST-2准确率达88.99%,接近非私有基线91.1。
  • 适合对隐私要求极高且需实用性能的模型微调场景。

我们提出PACZero,一类基于符号量化的零阶机制,用于大语言模型的PAC私密微调,在$ I(S^*; Y_{1:T})=0 $条件下仍具备可用性能。该隐私范式将成员推断攻击(MIA)后验成功率控制在先验水平,DP框架仅在$\varepsilon=0$且无限噪声时可达到此水平。所有对比均在相同MIA后验水平下进行。核心思想是:当释放结果依赖于哪个候选子集为秘密时,才计入互信息;符号量化聚合梯度可产生频繁的共识步骤,此时释放符号的条件互信息为零。我们提出两种变体:PACZero-MI(通过精确校准二值释放控制互信息预算)和PACZero-ZPL(在分歧步骤以均匀硬币翻转实现$ I=0 $)。在SST-2和SQuAD上评估OPT-1.3B与OPT-6.7B,采用LoRA和全参数微调。在$ I=0 $的全参数微调中,PACZero-ZPL在SST-2上达到${88.99\pm0.91}$,比非私有基线MeZO低2.1个百分点(91.1 FT)。此前无方法能在$\varepsilon<1$高隐私下获得可用性能,而PACZero-ZPL在OPT-1.3B和OPT-6.7B上均实现了竞争性SST-2准确率和非平凡的SQuAD F1。

原文摘要 · Abstract (English)

We introduce PACZero, a family of PAC-private zeroth-order mechanisms for fine-tuning large language models that delivers usable utility at $I(S^*; Y_{1:T})=0$. This privacy regime bounds the membership-inference attack (MIA) posterior success rate at the prior, an MIA-resistance level the DP framework matches only at $\varepsilon=0$ and infinite noise. All DP-ZO comparisons below are matched at the MIA posterior level. The key insight is that PAC Privacy charges mutual information only when the release depends on which candidate subset is the secret. Sign-quantizing subset-aggregated zeroth-order gradients creates frequent unanimity, steps at which every candidate subset agrees on the update direction; at these steps the released sign costs zero conditional mutual information. We propose two variants that span the privacy-utility trade-off: PACZero-MI (budgeted MI via exact calibration on the binary release) and PACZero-ZPL ($I=0$ via a uniform coin flip on disagreement steps). We evaluate on SST-2 and SQuAD with OPT-1.3B and OPT-6.7B in both LoRA and full-parameter tracks. On SST-2 OPT-1.3B full fine-tuning at $I=0$, PACZero-ZPL reaches ${88.99\pm0.91}$, within $2.1$pp of the non-private MeZO baseline ($91.1$ FT). No prior method produces usable utility in the high-privacy regime $\varepsilon<1$, and PACZero-ZPL obtains competitive SST-2 accuracy and nontrivial SQuAD F1 across OPT-1.3B and OPT-6.7B at $I=0$.

隐私微调零阶优化符号量化PAC隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。