通过特征空间扰动保护图像修复模型免遭知识蒸馏攻击
Defense against Unauthorized Distillation in Image Restoration via Feature Space Perturbation
- 在教师模型内部特征图上进行奇异值扰动,注入高频噪声
- 使学生模型学习效果下降,PSNR降低最多4dB,SSIM下降60-75%
- 适用于超分辨率、低光增强等五类图像修复任务
知识蒸馏攻击威胁深度模型知识产权,使攻击者能利用教师模型输出训练学生网络。现有分类任务中的防御方法难以应用于图像修复,因其为生成任务,输出为连续高维数据且依赖空间一致性与细节。微小扰动常无效,学生仍可学习映射关系。为此,我们提出自适应奇异值扰动(ASVP),一种针对图像修复的运行时防御机制。ASVP基于奇异值分解(SVD)对教师模型内部特征图进行处理,放大前k个奇异值,注入结构化高频扰动,破坏蒸馏所需的对齐关系,同时保持教师输出质量。我们在超分辨率、低光增强、水下增强、去雾和去雨五个图像修复任务上评估了ASVP。实验表明,该方法使学生网络的PSNR最高下降4 dB,SSIM下降60%-75%,对教师性能影响极小。相比已有方法,ASVP提供更强且更一致的防护能力。本方法为开源修复模型提供了实用的防盗版解决方案。
原文摘要 · Abstract (English)
Knowledge distillation (KD) attacks pose a significant threat to deep model intellectual property by enabling adversaries to train student networks using a teacher model's outputs. While recent defenses in image classification have successfully disrupted KD by perturbing output probabilities, extending these methods to image restoration is difficult. Unlike classification, restoration is a generative task with continuous, high-dimensional outputs that depend on spatial coherence and fine details. Minor perturbations are often insufficient, as students can still learn the underlying mapping.To address this, we propose Adaptive Singular Value Perturbation (ASVP), a runtime defense tailored for image restoration models. ASVP operates on internal feature maps of the teacher using singular value decomposition (SVD). It amplifies the topk singular values to inject structured, high-frequency perturbations, disrupting the alignment needed for distillation. This hinders student learning while preserving the teacher's output quality.We evaluate ASVP across five image restoration tasks: super-resolution, low-light enhancement, underwater enhancement, dehazing, and deraining. Experiments show ASVP reduces student PSNR by up to 4 dB and SSIM by 60-75%, with negligible impact on the teacher's performance. Compared to prior methods, ASVP offers a stronger and more consistent defense.Our approach provides a practical solution to protect open-source restoration models from unauthorized knowledge distillation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。