arXiv:2507.16872cs.CRcs.AI2025-07被引 3

模型压缩会加剧隐私泄露,该研究首次系统评估了压缩带来的隐私风险。

CompLeak: Deep Learning Model Compression Exacerbates Privacy Leakage

  • 提出CompLeak框架,从成员推断攻击视角分析剪枝、量化和权值聚类的隐私影响。
  • 在7种模型、6个数据集上验证,压缩后隐私泄露程度显著上升,最高达35%以上。
  • 适合关注AI模型部署安全性的研究人员与工程师阅读。

模型压缩对降低深度学习模型内存占用和加速推理至关重要,尤其在大型语言模型等基础模型中。用户可根据资源选择不同压缩版本。然而,现有压缩方法主要关注资源效率与性能的权衡,忽视了压缩引入的隐私风险。本文通过成员推断攻击(MIA)视角,提出CompLeak——首个针对谷歌TensorFlow Lite与脸书PyTorch Mobile支持的剪枝、量化、权值聚类三种压缩配置的隐私风险评估框架。该框架包含三种变体:CompLeakNR攻击单个压缩模型,发现不同压缩版本对成员与非成员影响不同;CompLeakSR利用原始模型与压缩模型的元信息(如置信度向量)联合分析,揭示更多隐私泄露;CompLeakMR则通过多个压缩版本的信息融合,显著放大整体隐私泄露。实验覆盖7种模型架构(从ResNet到BERT、GPT-2),以及6个图像与文本基准数据集,结果表明压缩显著加剧隐私泄露,最高提升超35%。

原文摘要 · Abstract (English)

Model compression is crucial for minimizing memory storage and accelerating inference in deep learning (DL) models, including recent foundation models like large language models (LLMs). Users can access different compressed model versions according to their resources and budget. However, while existing compression operations primarily focus on optimizing the trade-off between resource efficiency and model performance, the privacy risks introduced by compression remain overlooked and insufficiently understood. In this work, through the lens of membership inference attack (MIA), we propose CompLeak, the first privacy risk evaluation framework examining three widely used compression configurations that are pruning, quantization, and weight clustering supported by the commercial model compression framework of Google's TensorFlow-Lite (TF-Lite) and Facebook's PyTorch Mobile. CompLeak has three variants, given available access to the number of compressed models and original model. CompLeakNR starts by adopting existing MIA methods to attack a single compressed model, and identifies that different compressed models influence members and non-members differently. When the original model and one compressed model are available, CompLeakSR leverages the compressed model as a reference to the original model and uncovers more privacy by combining meta information (e.g., confidence vector) from both models. When multiple compressed models are available with/without accessing the original model, CompLeakMR innovatively exploits privacy leakage info from multiple compressed versions to substantially signify the overall privacy leakage. We conduct extensive experiments on seven diverse model architectures (from ResNet to foundation models of BERT and GPT-2), and six image and textual benchmark datasets.

模型压缩隐私泄露成员推断攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。