arXiv:2509.15230cs.LGcs.AI2025-09中稿 · ACM multimedia 202…被引 2

用提示词设计让模型能一键删掉特定数据,无需重训

Pre-Forgettable Models: Prompt Learning as a Native Mechanism for Unlearning

  • 把知识存到专用提示词里,删掉就行
  • 删完仍保持其他类准确率,遗忘效果明显
  • 适合隐私敏感场景,抗入侵能力强

基础模型通过跨模态和任务的鲁棒表征重塑了多媒体分析。然而,其静态部署与日益增长的社会和监管需求冲突——尤其是根据GDPR等隐私框架要求,需按请求删除特定数据。传统去学习方法如重训练、激活编辑或蒸馏通常计算成本高、脆弱且不适用于实时或持续演化的系统。本文提出范式转变:将去学习视为内置能力而非事后干预。我们引入基于提示的学习框架,在单一训练阶段统一知识获取与移除。该方法不将信息编码于模型权重,而是将类别语义绑定至专用提示词。由此,仅需移除对应提示词即可实现即时去学习,无需重训练、模型修改或原始数据访问。实验表明,该框架在保留类上维持预测性能的同时,有效消除被遗忘类。此外,该方法具备强隐私与安全保障:抵御成员推断攻击,提示词移除可防止任何残留知识提取,即使在对抗条件下亦然。这确保符合数据保护原则,并防范未授权访问遗忘信息,使框架适用于敏感与受监管环境。总体而言,通过将可移除性嵌入架构本身,本工作为设计模块化、可扩展、伦理响应的AI模型奠定了新基础。

原文摘要 · Abstract (English)

Foundation models have transformed multimedia analysis by enabling robust and transferable representations across diverse modalities and tasks. However, their static deployment conflicts with growing societal and regulatory demands -- particularly the need to unlearn specific data upon request, as mandated by privacy frameworks such as the GDPR. Traditional unlearning approaches, including retraining, activation editing, or distillation, are often computationally expensive, fragile, and ill-suited for real-time or continuously evolving systems. In this paper, we propose a paradigm shift: rethinking unlearning not as a retroactive intervention but as a built-in capability. We introduce a prompt-based learning framework that unifies knowledge acquisition and removal within a single training phase. Rather than encoding information in model weights, our approach binds class-level semantics to dedicated prompt tokens. This design enables instant unlearning simply by removing the corresponding prompt -- without retraining, model modification, or access to original data. Experiments demonstrate that our framework preserves predictive performance on retained classes while effectively erasing forgotten ones. Beyond utility, our method exhibits strong privacy and security guarantees: it is resistant to membership inference attacks, and prompt removal prevents any residual knowledge extraction, even under adversarial conditions. This ensures compliance with data protection principles and safeguards against unauthorized access to forgotten information, making the framework suitable for deployment in sensitive and regulated environments. Overall, by embedding removability into the architecture itself, this work establishes a new foundation for designing modular, scalable and ethically responsive AI models.

去学习提示词隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。