企业AI需强制执行用户感知的访问控制,防止敏感数据泄露。
Enterprise AI Must Enforce Participant-Aware Access Control
- 基于用户交互权限设计细粒度访问控制机制
- 实验证明现有防御手段无法阻止数据外泄攻击
- 适用于需安全使用私有数据的AI系统开发人员
大型语言模型在企业环境中日益普及,与多用户交互并使用敏感内部数据进行微调。尽管微调能提升性能,但会引入机密数据泄露风险。当结合检索增强生成(RAG)系统时,该风险进一步加剧。我们展示了针对AI助手的数据外泄攻击,表明当前微调与RAG架构因缺乏访问控制而易被滥用。现有防护措施如提示净化、输出过滤、系统隔离及训练级隐私技术均为概率性,无法提供可靠保护。我们主张在微调和RAG推理中必须严格、确定地实施细粒度访问控制。提出一种新框架:任何用于训练、检索或生成的内容,仅限于本次交互中的所有用户授权使用。该方案已部署于微软Copilot Tuning,支持企业以私有数据微调模型。
原文摘要 · Abstract (English)
Large language models (LLMs) are increasingly deployed in enterprise settings where they interact with multiple users and are trained or fine-tuned on sensitive internal data. While fine-tuning enhances performance by internalizing domain knowledge, it also introduces a critical security risk: leakage of confidential training data to unauthorized users. These risks are exacerbated when LLMs are combined with Retrieval-Augmented Generation (RAG) pipelines that dynamically fetch contextual documents at inference time. We demonstrate data exfiltration attacks on AI assistants where adversaries can exploit current fine-tuning and RAG architectures to leak sensitive information by leveraging the lack of access control enforcement. We show that existing defenses, including prompt sanitization, output filtering, system isolation, and training-level privacy mechanisms, are fundamentally probabilistic and fail to offer robust protection against such attacks. We take the position that only a deterministic and rigorous enforcement of fine-grained access control during both fine-tuning and RAG-based inference can reliably prevent the leakage of sensitive data to unauthorized recipients. We introduce a framework centered on the principle that any content used in training, retrieval, or generation by an LLM is explicitly authorized for \emph{all users involved in the interaction}. Our approach offers a simple yet powerful paradigm shift for building secure multi-user LLM systems that are grounded in classical access control but adapted to the unique challenges of modern AI workflows. Our solution has been deployed in Microsoft Copilot Tuning, a product offering that enables organizations to fine-tune models using their own enterprise-specific data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。