一种可统一处理视觉与音频模型的高效删忆方法
Graph Propagated Projection Unlearning: A Unified Framework for Vision and Audio Discriminative Models
- 用图传播定位特征空间中特定类别的方向并投影到正交子空间
- 在6个视觉数据集和2个音频基准上实现10-20倍加速
- 适合需要合规删忆或模型动态更新的研究者
随着隐私保护、合规需求和系统自适应设计的重要性提升,从深度神经网络中选择性且高效地删除已学信息变得愈发关键。本文提出图传播投影删忆(GPPU),一种适用于视觉与音频模型的统一可扩展算法。GPPU通过图结构传播识别特征空间中的类别专属方向,将表示投影至正交子空间,并结合针对性微调,确保目标类别信息被有效且不可逆地移除。在六个视觉数据集和两个大规模音频基准上,涵盖CNN、视觉变换器及音频变换器等多种架构的全面评估表明,GPPU实现了远超以往方法的高效删忆,在保留未删类别性能的同时,提速达10-20倍。该框架为机器删忆提供了原理严谨、跨模态通用的新范式,填补了此前研究在大规模验证方面的空白,推动更高效、更负责任的深度学习发展。
原文摘要 · Abstract (English)
The need to selectively and efficiently erase learned information from deep neural networks is becoming increasingly important for privacy, regulatory compliance, and adaptive system design. We introduce Graph-Propagated Projection Unlearning (GPPU), a unified and scalable algorithm for class-level unlearning that operates across both vision and audio models. GPPU employs graph-based propagation to identify class-specific directions in the feature space and projects representations onto the orthogonal subspace, followed by targeted fine-tuning, to ensure that target class information is effectively and irreversibly removed. Through comprehensive evaluations on six vision datasets and two large-scale audio benchmarks spanning a variety of architectures including CNNs, Vision Transformers, and Audio Transformers, we demonstrate that GPPU achieves highly efficient unlearning, realizing 10-20x speedups over prior methodologies while preserving model utility on retained classes. Our framework provides a principled and modality-agnostic approach to machine unlearning, evaluated at a scale that has received limited attention in prior work, contributing toward more efficient and responsible deep learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。