arXiv:2512.15335cs.LGcs.CR2025-12中稿 · TrustCom 2025被引 1

量化可降低模型隐私泄露风险,4位以下精度降幅超九成

Bits for Privacy: Evaluating Post-Training Quantization via Membership Inference

  • 用成员推理攻击评估三种后训练量化方法的隐私表现
  • 1.58位量化使隐私漏洞降低一个数量级,但模型性能下降
  • 仅对最后一层保持高精度,可精细调节隐私与效果平衡

深度神经网络常通过降低参数精度的量化技术来减少内存和计算开销。尽管量化会改变模型参数与输出,现有隐私分析主要针对全精度模型,未充分探讨比特宽度缩减对隐私泄露的影响。本文首次系统研究后训练量化(PTQ)中的隐私-效用关系,采用成员推理攻击作为评估框架,分析AdaRound、BRECQ和OBC三种主流算法在CIFAR-10、CIFAR-100和TinyImageNet数据集上4位、2位及1.58位等多种精度下的表现。结果一致显示:低精度PTQ能显著降低隐私泄露。尤其在1.58位时,模型成员推理脆弱性相比全精度降低约一个数量级,代价是模型性能下降。额外消融实验表明,在1.58位下仅对最后层进行高精度量化,可实现对隐私-效用权衡的细粒度控制。该研究为实际部署中兼顾效率、性能与隐私保护提供可行方案。

原文摘要 · Abstract (English)

Deep neural networks are widely deployed with quantization techniques to reduce memory and computational costs by lowering the numerical precision of their parameters. While quantization alters model parameters and their outputs, existing privacy analyses primarily focus on full-precision models, leaving a gap in understanding how bit-width reduction can affect privacy leakage. We present the first systematic study of the privacy-utility relationship in post-training quantization (PTQ), a versatile family of methods that can be applied to pretrained models without further training. Using membership inference attacks as our evaluation framework, we analyze three popular PTQ algorithms-AdaRound, BRECQ, and OBC-across multiple precision levels (4-bit, 2-bit, and 1.58-bit) on CIFAR-10, CIFAR-100, and TinyImageNet datasets. Our findings consistently show that low-precision PTQs can reduce privacy leakage. In particular, lower-precision models demonstrate up to an order of magnitude reduction in membership inference vulnerability compared to their full-precision counterparts, albeit at the cost of decreased utility. Additional ablation studies on the 1.58-bit quantization level show that quantizing only the last layer at higher precision enables fine-grained control over the privacy-utility trade-off. These results offer actionable insights for practitioners to balance efficiency, utility, and privacy protection in real-world deployments.

量化隐私保护成员推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。