arXiv:2601.11199cs.CRcs.AI2026-01被引 6

SD-RAG通过检索阶段控制敏感信息披露,有效防住提示注入攻击。

SD-RAG: A Prompt-Injection-Resilient Framework for Selective Disclosure in Retrieval-Augmented Generation

  • 在检索阶段执行信息净化与披露控制,不依赖生成模型的提示约束。
  • 隐私得分最高提升58%,且对提示注入攻击有强防御能力。
  • 支持动态安全策略,适合需要严格数据隐私的生成系统。

检索增强生成(RAG)结合大语言模型(LLM)的生成能力与大规模数据检索机制,受到广泛关注。然而,现有方法常忽视将敏感或受控信息直接暴露给生成模型的风险。少数研究尝试通过指令引导模型避免披露敏感内容,但近期研究表明LLM仍易受提示注入攻击影响,可绕过预设行为限制。为此,本文提出一种新型选择性披露框架SD-RAG,将安全与隐私约束的执行从生成过程解耦,转而在检索阶段实施。SD-RAG在输入增强前对检索结果进行净化与披露控制,引入语义机制支持人类可读的动态安全策略,并采用优化的基于图的数据模型实现细粒度、策略感知的检索。实验表明,相比基线方法,SD-RAG在隐私得分上最高提升58%,同时展现出对针对生成模型的提示注入攻击的强大鲁棒性。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) has attracted significant attention due to its ability to combine the generative capabilities of Large Language Models (LLMs) with knowledge obtained through efficient retrieval mechanisms over large-scale data collections. Currently, the majority of existing approaches overlook the risks associated with exposing sensitive or access-controlled information directly to the generation model. Only a few approaches propose techniques to instruct the generative model to refrain from disclosing sensitive information; however, recent studies have also demonstrated that LLMs remain vulnerable to prompt injection attacks that can override intended behavioral constraints. For these reasons, we propose a novel approach to Selective Disclosure in Retrieval-Augmented Generation, called SD-RAG, which decouples the enforcement of security and privacy constraints from the generation process itself. Rather than relying on prompt-level safeguards, SD-RAG applies sanitization and disclosure controls during the retrieval phase, prior to augmenting the language model's input. Moreover, we introduce a semantic mechanism to allow the ingestion of human-readable dynamic security and privacy constraints together with an optimized graph-based data model that supports fine-grained, policy-aware retrieval. Our experimental evaluation demonstrates the superiority of SD-RAG over baseline existing approaches, achieving up to a $58\%$ improvement in the privacy score, while also showing a strong resilience to prompt injection attacks targeting the generative model.

RAG隐私保护提示注入

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。