arXiv:2508.09105cs.AI2025-08被引 4

首次实现对检索增强生成系统中内容来源的精细审计,解决隐私泄露追踪难题。

SMA: Who Said That? Auditing Membership Leakage in Semi-Black-box RAG Controlling

  • 提出SMA审计框架,可区分生成内容来自训练数据、外部检索还是用户输入。
  • 通过零阶优化与大规模扰动采样,实现对输入词元影响的鲁棒估计。
  • 首创跨模态归因技术,支持图像检索痕迹的文本级溯源,适用于多模态系统。

检索增强生成(RAG)及其多模态版本(MRAG)通过引入外部知识源显著提升了大语言模型的知识覆盖与上下文理解能力。然而,检索与多模态融合使内容来源模糊,现有成员推断方法无法可靠区分生成内容源自预训练数据、外部检索或用户输入,削弱了隐私泄露的责任追溯能力。为此,我们提出首个面向半黑盒环境的源感知成员审计(SMA)框架,具备检索控制能力,可实现细粒度的内容来源归因。针对半黑盒审计的环境限制,我们设计了一种基于零阶优化的归因估计机制,通过大规模扰动采样与岭回归建模,稳健地逼近输入词元对输出的真实影响。此外,SMA引入跨模态归因技术,利用多模态大模型(MLLMs)将图像输入映射为文本描述,实现文本模态下的词元级归因,首次支持在MRAG系统中对图像检索痕迹进行成员推断。本工作将成员推断的关注点从‘数据是否被记忆’转向‘内容源自何处’,为复杂生成系统中的数据溯源提供了新视角。

原文摘要 · Abstract (English)

Retrieval-Augmented Generation (RAG) and its Multimodal Retrieval-Augmented Generation (MRAG) significantly improve the knowledge coverage and contextual understanding of Large Language Models (LLMs) by introducing external knowledge sources. However, retrieval and multimodal fusion obscure content provenance, rendering existing membership inference methods unable to reliably attribute generated outputs to pre-training, external retrieval, or user input, thus undermining privacy leakage accountability To address these challenges, we propose the first Source-aware Membership Audit (SMA) that enables fine-grained source attribution of generated content in a semi-black-box setting with retrieval control capabilities. To address the environmental constraints of semi-black-box auditing, we further design an attribution estimation mechanism based on zero-order optimization, which robustly approximates the true influence of input tokens on the output through large-scale perturbation sampling and ridge regression modeling. In addition, SMA introduces a cross-modal attribution technique that projects image inputs into textual descriptions via MLLMs, enabling token-level attribution in the text modality, which for the first time facilitates membership inference on image retrieval traces in MRAG systems. This work shifts the focus of membership inference from 'whether the data has been memorized' to 'where the content is sourced from', offering a novel perspective for auditing data provenance in complex generative systems.

成员推断RAG多模态数据溯源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。