让生成式AI在不暴露数据和模型的前提下,安全地分布式运行。
Secure Multiparty Generative AI
- 用可验证的多方计算重构Transformer,实现输入、输出与模型本身的隐私保护。
- 只要有一个诚实节点,系统就保持安全;多数节点成功即可完成推理。
- 适合对数据安全要求高的企业或敏感内容生成场景。
随着生成式AI应用激增,敏感信息暴露给第三方模型提供商的问题日益严重。例如,三星的机密源代码因向ChatGPT输入文本而泄露。越来越多公司(如苹果、威瑞森、摩根大通)因数据泄露或保密问题限制使用大语言模型。同时,中心化生成模型平台(如Midjourney、RunwayML)也通过提示词过滤限制政治人物、女性健康等敏感内容生成。本研究提出一种安全私密的生成式AI方法,不将敏感数据或模型暴露给第三方。通过改造现代生成式AI的核心组件——Transformer,并引入去中心化网络中的可信多方计算,实现用户输入的隐私保护和输出的混淆,同时保障模型自身的隐私。此外,分片机制降低单个节点的计算负担,使大型生成任务可分布到多个小型节点上执行。我们证明:只要存在一个诚实节点,系统即保持安全;只要多数节点成功,推理过程仍可完成。该方法在去中心化网络中实现了安全且可验证的计算。
原文摘要 · Abstract (English)
As usage of generative AI tools skyrockets, the amount of sensitive information being exposed to these models and centralized model providers is alarming. For example, confidential source code from Samsung suffered a data leak as the text prompt to ChatGPT encountered data leakage. An increasing number of companies are restricting the use of LLMs (Apple, Verizon, JPMorgan Chase, etc.) due to data leakage or confidentiality issues. Also, an increasing number of centralized generative model providers are restricting, filtering, aligning, or censoring what can be used. Midjourney and RunwayML, two of the major image generation platforms, restrict the prompts to their system via prompt filtering. Certain political figures are restricted from image generation, as well as words associated with women's health care, rights, and abortion. In our research, we present a secure and private methodology for generative artificial intelligence that does not expose sensitive data or models to third-party AI providers. Our work modifies the key building block of modern generative AI algorithms, e.g. the transformer, and introduces confidential and verifiable multiparty computations in a decentralized network to maintain the 1) privacy of the user input and obfuscation to the output of the model, and 2) introduce privacy to the model itself. Additionally, the sharding process reduces the computational burden on any one node, enabling the distribution of resources of large generative AI processes across multiple, smaller nodes. We show that as long as there exists one honest node in the decentralized computation, security is maintained. We also show that the inference process will still succeed if only a majority of the nodes in the computation are successful. Thus, our method offers both secure and verifiable computation in a decentralized network.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。