arXiv:2504.09095cs.CRcs.AI2025-04被引 1

提出防御生成式AI泄露隐私的实用方案,兼顾安全与功能

Privacy Preservation in Gen AI Applications

  • 通过数据提取、模型逆推等攻击检测LLM隐私漏洞
  • 在输入处理阶段识别并清除敏感信息,防止泄露
  • 适合关注AI合规与数据安全的研发者和产品团队

生成式人工智能(Gen AI)与大语言模型(LLMs)的快速发展推动了客服、医疗、金融等领域的变革。然而,训练数据中可能包含个人身份信息(PII),导致模型在用户交互中无意泄露隐私。由于深度神经网络结构复杂,难以追踪或阻止私密信息的存储与暴露,引发了严重隐私与安全风险。本文通过数据提取、模型逆推和成员推理等攻击手段,系统评估生成式AI的隐私脆弱性,并提出一种隐私保护框架:在输入传递给LLM前,主动识别、修改或移除敏感信息,实现强防护而不牺牲功能。同时,调研了微软Azure、谷歌云和AWS等主流云平台的隐私保护工具能力。最终构建了一个以数据安全与伦理实施为核心的生成式AI隐私范式,为更安全、负责任的AI应用提供基础支撑。

原文摘要 · Abstract (English)

The ability of machines to comprehend and produce language that is similar to that of humans has revolutionized sectors like customer service, healthcare, and finance thanks to the quick advances in Natural Language Processing (NLP), which are fueled by Generative Artificial Intelligence (AI) and Large Language Models (LLMs). However, because LLMs trained on large datasets may unintentionally absorb and reveal Personally Identifiable Information (PII) from user interactions, these capabilities also raise serious privacy concerns. Deep neural networks' intricacy makes it difficult to track down or stop the inadvertent storing and release of private information, which raises serious concerns about the privacy and security of AI-driven data. This study tackles these issues by detecting Generative AI weaknesses through attacks such as data extraction, model inversion, and membership inference. A privacy-preserving Generative AI application that is resistant to these assaults is then developed. It ensures privacy without sacrificing functionality by using methods to identify, alter, or remove PII before to dealing with LLMs. In order to determine how well cloud platforms like Microsoft Azure, Google Cloud, and AWS provide privacy tools for protecting AI applications, the study also examines these technologies. In the end, this study offers a fundamental privacy paradigm for generative AI systems, focusing on data security and moral AI implementation, and opening the door to a more secure and conscientious use of these tools.

生成式AI隐私保护大模型数据安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。