arXiv:2409.03326cs.CV2024-09被引 1

用扩散模型和机器遗忘实现图像隐私保护的动态平衡

Enhancing User-Centric Privacy Protection: An Interactive Framework through Diffusion Models and Machine Unlearning

  • 通过属性级图像修改与模型参数遗忘双机制保护隐私
  • 在人脸数据集上实现多属性分类精度优于现有方法
  • 支持用户交互调节隐私强度,兼顾效果与隐私

在多媒体数据分析领域,图像数据集的广泛使用加剧了隐私泄露风险。现有研究多聚焦于数据共享或模型发布阶段的隐私保护,而本文提出首个在数据共享与模型发布双阶段同步保护隐私的框架。该框架采用生成式模型在属性层面修改图像信息,并结合机器遗忘算法更新模型参数,实现用户交互式调节隐私强度,在保障最大隐私的同时维持模型性能。具体实现两个模块:基于差分隐私的扩散模型用于保护图像属性信息,特征遗忘算法实现对修订数据集的高效模型更新。实验表明,该方法在多个面部数据集上对各类属性分类任务的表现均优于现有方法。

原文摘要 · Abstract (English)

In the realm of multimedia data analysis, the extensive use of image datasets has escalated concerns over privacy protection within such data. Current research predominantly focuses on privacy protection either in data sharing or upon the release of trained machine learning models. Our study pioneers a comprehensive privacy protection framework that safeguards image data privacy concurrently during data sharing and model publication. We propose an interactive image privacy protection framework that utilizes generative machine learning models to modify image information at the attribute level and employs machine unlearning algorithms for the privacy preservation of model parameters. This user-interactive framework allows for adjustments in privacy protection intensity based on user feedback on generated images, striking a balance between maximal privacy safeguarding and maintaining model performance. Within this framework, we instantiate two modules: a differential privacy diffusion model for protecting attribute information in images and a feature unlearning algorithm for efficient updates of the trained model on the revised image dataset. Our approach demonstrated superiority over existing methods on facial datasets across various attribute classifications.

隐私保护扩散模型机器遗忘

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。