仅用1个数据点即可实现文本嵌入逆向攻击,突破传统高成本限制。
ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation
- 通过对齐与生成结合,单样本即可启动逆向攻击
- 仅需1000样本即达最优攻击效果,无需泄露训练数据
- 攻击可跨语言跨领域迁移,现有防御均无效
随着大语言模型和向量数据库的普及,敏感文本数据常以数值嵌入形式存储。然而,近期研究证实此类嵌入易受逆向攻击,导致原始文本被还原从而泄露隐私。以往方法通常依赖数百万句数据训练攻击模型,如通过数据泄露或近乎无限制的API访问。本文提出一种少样本文本嵌入逆向攻击方法ALGEN(Alignment and Generation),仅需单个数据点即可实现部分成功的逆向攻击。在仅1000个样本条件下,性能即可达到黑盒编码器的最优水平,且无需使用泄露数据进行训练。ALGEN通过将目标嵌入对齐至攻击空间,并利用生成模型重构文本,展现出良好的跨领域、跨语言迁移能力,能有效揭示关键信息。我们进一步评估多种防御机制,发现均无法有效抵御该攻击,凸显了嵌入逆向攻击的严重性。本工作显著降低了逆向攻击的成本,证明嵌入空间可通过一步优化对齐,为自然语言处理中的嵌入对齐开辟新范式。
原文摘要 · Abstract (English)
With the growing popularity of Large Language Models (LLMs) and vector databases, private textual data is increasingly processed and stored as numerical embeddings. However, recent studies have proven that such embeddings are vulnerable to inversion attacks, where original text is reconstructed to reveal sensitive information. Previous research has largely assumed access to millions of sentences to train attack models, e.g., through data leakage or nearly unrestricted API access. With our method, a single data point is sufficient for a partially successful inversion attack. With as little as 1k data samples, performance reaches an optimum across a range of black-box encoders, without training on leaked data. We present a Few-shot Textual Embedding Inversion Attack using ALignment and GENeration (ALGEN), by aligning victim embeddings to the attack space and using a generative model to reconstruct text. We find that ALGEN attacks can be effectively transferred across domains and languages, revealing key information. We further examine a variety of defense mechanisms against ALGEN, and find that none are effective, highlighting the vulnerabilities posed by inversion attacks. By significantly lowering the cost of inversion and proving that embedding spaces can be aligned through one-step optimization, we establish a new textual embedding inversion paradigm with broader applications for embedding alignment in NLP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。