提出两种新型多模态知识投毒攻击,揭示RAG系统严重脆弱性。
MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks
- 设计局部与全局投毒策略,精准操控模型输出
- 局部攻击成功率最高达56%,全局攻击使准确率归零
- 可绕过现有防御,适合安全与可信AI研究者参考
检索增强生成(RAG)已成为多模态大语言模型(MLLM)提升事实准确性、减少幻觉的常见方法。然而,其依赖外部检索机制,易受知识投毒攻击:攻击者故意向知识库注入恶意多模态内容,诱导模型生成错误甚至有害回应。本文提出MM-PoisonRAG框架,系统研究多模态RAG在知识投毒下的脆弱性。设计两种新攻击策略:局部投毒攻击(LPA),针对特定查询植入多模态误导信息,实现可控输出;全局投毒攻击(GPA),仅用一条无目标投毒内容即广泛破坏所有查询的推理与生成质量。在多种任务、组件及攻击权限条件下实验表明:LPA在受限访问下仍达56%攻击成功率,且可跨四种检索器迁移无需重优化;GPA仅需一次注入即导致生成准确率降至0%。二者均能绕过现有防御,凸显多模态RAG的脆弱性,并确立MM-PoisonRAG作为未来防护研究的基础。
原文摘要 · Abstract (English)
Retrieval-augmented generation (RAG) has become a common practice in multimodal large language models (MLLM) to enhance factual grounding and reduce hallucination. Yet, its reliance on retrieval exposes MLLMs to knowledge poisoning attacks, in which adversaries deliberately inject malicious multimodal content into external knowledge bases to steer models toward generating incorrect or even harmful responses. We present MM-PoisonRAG, a framework to systematically study the vulnerability of multimodal RAG under knowledge poisoning. Specifically, we design two novel attack strategies: Localized Poisoning Attack (LPA), which implants targeted, query-specific multimodal misinformation to manipulate outputs toward attacker-controlled responses, and Globalized Poisoning Attack (GPA), which uses a single, untargeted adversarial injection to broadly corrupt reasoning and collapse generation quality across all queries. Extensive experiments on diverse tasks, multimodal RAG components, and attacker access levels reveal severe vulnerabilities: LPA achieves up to 56% attack success rate even under restricted access, and transfers effectively across four different retrievers without re-optimizing the adversaries. GPA completely disrupts model generation to 0% accuracy with just one poisoned content. Moreover, both LPA and GPA bypass existing defenses, underscoring the fragility of multimodal RAG and establishing MM-PoisonRAG as a foundation for future research on securing RAG frameworks against multimodal knowledge poisoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。