检索增强的扩散模型存在后门漏洞,可被恶意操控生成有害内容。
Retrievals Can Be Detrimental: Unveiling the Backdoor Vulnerability of Retrieval-Augmented Diffusion Models
- 通过对比学习在检索库中植入毒物图像,构建文本触发到有害输出的捷径。
- 攻击成功率超90%,且不影响模型正常生成能力。
- 适合关注AI安全、检索增强系统风险的研究者阅读。
扩散模型(DMs)近期展现出强大的生成能力,但其训练通常需要巨大计算资源和大规模数据集。为缓解此问题,研究者引入先进的检索增强生成(RAG)技术,提出检索增强扩散模型(RDMs)。RDMs通过从辅助数据库中引入丰富知识,显著提升生成与泛化能力,并大幅减少模型参数。然而,RAG可能引入新的安全问题。本文揭示了RDM易受后门攻击,提出一种名为BadRDM的多模态对比攻击方法。该框架充分考虑RAG特性,旨在操纵特定文本触发下的检索结果,进而控制生成内容。具体而言,先在检索库中植入少量图像作为目标毒性代理;随后采用恶意变体的对比学习,使触发词与毒物代理之间建立捷径;此外,通过基于熵的选择与生成增强策略,进一步优化毒物代理。在两个主流任务上的实验表明,BadRDM攻击效果显著,攻击成功率超过90%,同时保持模型原有良性功能。
原文摘要 · Abstract (English)
Diffusion models (DMs) have recently demonstrated remarkable generation capability. However, their training generally requires huge computational resources and large-scale datasets. To solve these, recent studies empower DMs with the advanced Retrieval-Augmented Generation (RAG) technique and propose retrieval-augmented diffusion models (RDMs). By incorporating rich knowledge from an auxiliary database, RAG enhances diffusion models' generation and generalization ability while significantly reducing model parameters. Despite the great success, RAG may introduce novel security issues that warrant further investigation. In this paper, we reveal that the RDM is susceptible to backdoor attacks by proposing a multimodal contrastive attack approach named BadRDM. Our framework fully considers RAG's characteristics and is devised to manipulate the retrieved items for given text triggers, thereby further controlling the generated contents. Specifically, we first insert a tiny portion of images into the retrieval database as target toxicity surrogates. Subsequently, a malicious variant of contrastive learning is adopted to inject backdoors into the retriever, which builds shortcuts from triggers to the toxicity surrogates. Furthermore, we enhance the attacks through novel entropy-based selection and generative augmentation strategies that can derive better toxicity surrogates. Extensive experiments on two mainstream tasks demonstrate the proposed BadRDM achieves outstanding attack effects while preserving the model's benign utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。