arXiv:2410.13138cs.CLcs.CR2024-10被引 4

通过对抗性提示注入,让数据拥有者自主阻止大模型读取敏感信息。

Data Defenses Against Large Language Models

  • 自动生成对抗提示,干扰大模型对文本的推理能力。
  • 在主流商业与开源模型上均有效,且抗反制、生成快速。
  • 适合关注隐私保护与数据主权的研究者与内容创作者。

大语言模型在文本推理、信息提取和内容生成方面表现卓越,但也引发监控、劳工替代和知识产权侵犯等伦理问题。现有政策与技术缓解措施常因机构响应滞后或缺乏动力而失效。本文提出“数据防御”新策略,使数据所有者能直接阻止大模型对其数据的推理。通过自动构建对抗性提示注入,显著降低大模型识别个人身份信息或复制受版权保护文本的能力。实验验证该方法成本低、速度快,适用于最新商业与开源模型,且对多种攻击场景具有鲁棒性。同时探讨了其安全影响,并指出未来研究方向。代码与在线防护工具已公开:https://github.com/wagnew3/LLMDataDefenses 及 https://wagnew3.github.io/LLM-Data-Defenses/

原文摘要 · Abstract (English)

Large language models excel at performing inference over text to extract information, summarize information, or generate additional text. These inference capabilities are implicated in a variety of ethical harms spanning surveillance, labor displacement, and IP/copyright theft. While many policy, legal, and technical mitigations have been proposed to counteract these harms, these mitigations typically require cooperation from institutions that move slower than technical advances (i.e., governments) or that have few incentives to act to counteract these harms (i.e., the corporations that create and profit from these LLMs). In this paper, we define and build "data defenses" -- a novel strategy that directly empowers data owners to block LLMs from performing inference on their data. We create data defenses by developing a method to automatically generate adversarial prompt injections that, when added to input text, significantly reduce the ability of LLMs to accurately infer personally identifying information about the subject of the input text or to use copyrighted text in inference. We examine the ethics of enabling such direct resistance to LLM inference, and argue that making data defenses that resist and subvert LLMs enables the realization of important values such as data ownership, data sovereignty, and democratic control over AI systems. We verify that our data defenses are cheap and fast to generate, work on the latest commercial and open-source LLMs, resistance to countermeasures, and are robust to several different attack settings. Finally, we consider the security implications of LLM data defenses and outline several future research directions in this area. Our code is available at https://github.com/wagnew3/LLMDataDefenses and a tool for using our defenses to protect text against LLM inference is at https://wagnew3.github.io/LLM-Data-Defenses/.

隐私保护对抗样本数据主权

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。