arXiv:2604.06644cs.CVcs.LG2026-04中稿 · the 8th Internatio…

压缩特征以保护隐私,让指定模型用好,其他模型用不了。

Variational Feature Compression for Model-Specific Representations

论文配图:Variational Feature Compression for Model-Specific Representations
图 1 · 摘自论文原文
  • 用变分潜空间加动态掩码,抑制无关模型使用特征。
  • 在CIFAR-100上,非目标模型准确率低于2%,抑制比超45倍。
  • 适合需要精准控制数据用途的隐私敏感场景。

随着深度学习推理越来越多地部署在共享和云环境,输入数据被未经授权的模型复用的问题日益突出。现有隐私防护多聚焦于限制数据访问,对释放后的表示仍能支持哪些下游任务缺乏控制。本文提出一种特征提取框架,在保留指定分类器性能的同时,抑制跨模型迁移。该框架采用变分潜瓶颈,通过任务驱动的交叉熵损失与KL正则化训练,无需像素级重建损失,将输入编码为紧凑潜空间。通过计算每个维度的KL散度和对冻结目标模型的梯度显著性,生成动态二值掩码,屏蔽对目标任务无意义的潜变量维度。由于显著性计算需梯度访问,编码器在白盒环境下训练,而推理仅需对冻结目标模型进行前向传播。在CIFAR-100上,处理后的表示对指定分类器保持强效用,同时所有非目标分类器准确率降至2%以下,抑制比超过45倍。初步实验在CIFAR-10、Tiny ImageNet和Pascal VOC上显示方法可扩展至不同任务,但尚需评估对抗适应性攻击的鲁棒性。

原文摘要 · Abstract (English)

As deep learning inference is increasingly deployed in shared and cloud-based settings, a growing concern is input repurposing, in which data submitted for one task is reused by unauthorized models for another. Existing privacy defenses largely focus on restricting data access, but provide limited control over what downstream uses a released representation can still support. We propose a feature extraction framework that suppresses cross-model transfer while preserving accuracy for a designated classifier. The framework employs a variational latent bottleneck, trained with a task-driven cross-entropy objective and KL regularization, but without any pixel-level reconstruction loss, to encode inputs into a compact latent space. A dynamic binary mask, computed from per-dimension KL divergence and gradient-based saliency with respect to the frozen target model, suppresses latent dimensions that are uninformative for the intended task. Because saliency computation requires gradient access, the encoder is trained in a white-box setting, whereas inference requires only a forward pass through the frozen target model. On CIFAR-100, the processed representations retain strong utility for the designated classifier while reducing the accuracy of all unintended classifiers to below 2%, yielding a suppression ratio exceeding 45 times relative to unintended models. Preliminary experiments on CIFAR-10, Tiny ImageNet, and Pascal VOC provide exploratory evidence that the approach extends across task settings, although further evaluation is needed to assess robustness against adaptive adversaries.

隐私保护特征压缩模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。