攻击者可制造通用干扰项,让海量查询错误返回同一结果。
Adversarial Hubness in Multi-Modal Retrieval
- 通过少量随机查询生成对抗性中心点,诱导多模态检索系统出错。
- 单个对抗中心点在2.5万测试查询中被误检为最相关图像超2.1万次。
- 现有缓解自然中心现象的方法对针对性攻击无效,需新防御策略。
中心性是高维向量空间中的一种现象,即某个自然分布中的点意外地接近许多其他点。这在信息检索中是一个众所周知的问题,导致某些项目被错误地频繁匹配到大量查询。本文研究攻击者如何利用中心性,将任意图像或音频输入转变为多模态检索系统中的对抗性中心点。这些对抗性中心点可用于注入通用对抗内容(如垃圾信息),从而在数千种不同查询中被检索到;也可用于针对特定概念的定向攻击。我们提出一种生成对抗性中心点的方法,并在基准多模态检索数据集及Pinecone(一个流行的向量数据库)实现的图像到图像检索系统上进行评估。例如,在文本-标题到图像的检索中,仅使用100个随机查询生成的单个对抗性中心点,在25,000个测试查询中被检索为最相关的图像超过21,000次(相比之下,最常见的自然中心点仅在102个查询中位列第一),展示了对抗性中心点的强大泛化能力。我们还探讨了缓解自然中心性的技术是否能有效应对对抗性中心点,发现它们对针对特定概念的攻击无效。
原文摘要 · Abstract (English)
Hubness is a phenomenon in high-dimensional vector spaces where a point from the natural distribution is unusually close to many other points. This is a well-known problem in information retrieval that causes some items to accidentally (and incorrectly) appear relevant to many queries. In this paper, we investigate how attackers can exploit hubness to turn any image or audio input in a multi-modal retrieval system into an adversarial hub. Adversarial hubs can be used to inject universal adversarial content (e.g., spam) that will be retrieved in response to thousands of different queries, and also for targeted attacks on queries related to specific, attacker-chosen concepts. We present a method for creating adversarial hubs and evaluate the resulting hubs on benchmark multi-modal retrieval datasets and an image-to-image retrieval system implemented by Pinecone, a popular vector database. For example, in text-caption-to-image retrieval, a single adversarial hub, generated using 100 random queries, is retrieved as the top-1 most relevant image for more than 21,000 out of 25,000 test queries (by contrast, the most common natural hub is the top-1 response to only 102 queries), demonstrating the strong generalization capabilities of adversarial hubs. We also investigate whether techniques for mitigating natural hubness can also mitigate adversarial hubs, and show that they are not effective against hubs that target queries related to specific concepts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。