比较不同视觉模型的隐私风险,发现架构差异影响数据泄露程度。
Privacy Preserving Properties of Vision Classifiers
- 用网络反演技术测试MLP、CNN、ViT等模型的数据重建难易度。
- 不同架构重建精度差异显著,ViT比CNN更难逆向还原训练数据。
- 为敏感场景下的模型选型提供隐私保护参考,适合关注数据安全的研究者。
视觉分类器常在包含敏感信息的专有数据集上训练,但模型常被公开共享,基于其能保护训练数据隐私的假设。然而,这种假设对不同架构的有效性尚未明确。近年来,反演攻击已能从模型权重中重构训练数据,暴露出严重隐私漏洞。本文系统评估了多类视觉模型(包括多层感知机、卷积神经网络和视觉变换器)在隐私保护方面的表现。通过基于网络反演的重建技术,量化分析各架构对训练数据的记忆与泄露程度。研究发现,输入表示方式、特征提取机制及权重结构等架构差异显著影响隐私风险。对比表明,某些架构(如ViT)对反演攻击更具鲁棒性,同时揭示了模型性能与隐私保护之间的权衡。研究成果为敏感应用场景下安全且隐私友好的机器学习系统设计提供了可操作的指导。
原文摘要 · Abstract (English)
Vision classifiers are often trained on proprietary datasets containing sensitive information, yet the models themselves are frequently shared openly under the privacy-preserving assumption. Although these models are assumed to protect sensitive information in their training data, the extent to which this assumption holds for different architectures remains unexplored. This assumption is challenged by inversion attacks which attempt to reconstruct training data from model weights, exposing significant privacy vulnerabilities. In this study, we systematically evaluate the privacy-preserving properties of vision classifiers across diverse architectures, including Multi-Layer Perceptrons (MLPs), Convolutional Neural Networks (CNNs), and Vision Transformers (ViTs). Using network inversion-based reconstruction techniques, we assess the extent to which these architectures memorize and reveal training data, quantifying the relative ease of reconstruction across models. Our analysis highlights how architectural differences, such as input representation, feature extraction mechanisms, and weight structures, influence privacy risks. By comparing these architectures, we identify which are more resilient to inversion attacks and examine the trade-offs between model performance and privacy preservation, contributing to the development of secure and privacy-respecting machine learning models for sensitive applications. Our findings provide actionable insights into the design of secure and privacy-aware machine learning systems, emphasizing the importance of evaluating architectural decisions in sensitive applications involving proprietary or personal data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。