arXiv:2509.06026cs.CRcs.AI2025-09被引 9

提出新型成员推理攻击DCMI,精准识别RAG系统中敏感数据成员身份。

DCMI: A Differential Calibration Membership Inference Attack Against Retrieval-Augmented Generation

  • 利用查询扰动下成员与非成员文档的响应差异,分离成员文档贡献。
  • 在Flan-T5 RAG系统上达97.42% AUC和94.35%准确率,超基线40%以上。
  • 适用于真实平台如Dify、MaxKB,适合关注RAG隐私风险的研究者。

尽管检索增强生成(RAG)通过整合外部知识库有效减少幻觉,但其在处理敏感数据时引入了成员推理攻击(MIA)漏洞。现有针对RAG外部数据库的攻击多依赖模型输出,忽略非成员检索文档的干扰,限制了攻击效果。为此,本文提出DCMI——一种差分校准的成员推理攻击,可缓解非成员检索文档的负面影响。具体而言,DCMI利用成员与非成员检索文档在查询扰动下的敏感性差异,通过生成扰动查询进行校准,分离成员文档的贡献并最小化非成员文档的干扰。实验在逐步放松假设条件下显示,DCMI持续优于基线:例如在Flan-T5 RAG系统上达到97.42% AUC和94.35%准确率,超越基线超40%;在Dify与MaxKB等真实RAG平台亦保持10%-20%优势。结果凸显了RAG系统的显著隐私风险,呼吁加强防护机制研究。代码已开源于https://github.com/Xinyu140203/RAG_MIA。

原文摘要 · Abstract (English)

While Retrieval-Augmented Generation (RAG) effectively reduces hallucinations by integrating external knowledge bases, it introduces vulnerabilities to membership inference attacks (MIAs), particularly in systems handling sensitive data. Existing MIAs targeting RAG's external databases often rely on model responses but ignore the interference of non-member-retrieved documents on RAG outputs, limiting their effectiveness. To address this, we propose DCMI, a differential calibration MIA that mitigates the negative impact of non-member-retrieved documents. Specifically, DCMI leverages the sensitivity gap between member and non-member retrieved documents under query perturbation. It generates perturbed queries for calibration to isolate the contribution of member-retrieved documents while minimizing the interference from non-member-retrieved documents. Experiments under progressively relaxed assumptions show that DCMI consistently outperforms baselines--for example, achieving 97.42% AUC and 94.35% Accuracy against the RAG system with Flan-T5, exceeding the MBA baseline by over 40%. Furthermore, on real-world RAG platforms such as Dify and MaxKB, DCMI maintains a 10%-20% advantage over the baseline. These results highlight significant privacy risks in RAG systems and emphasize the need for stronger protection mechanisms. We appeal to the community's consideration of deeper investigations, like ours, against the data leakage risks in rapidly evolving RAG systems. Our code is available at https://github.com/Xinyu140203/RAG_MIA.

成员推理RAG安全隐私攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。