arXiv:2608.04477cs.CRcs.CL2026-08

提出新攻击方法DeepInvert,能从混淆语言模型中还原原始敏感词。

DeepInvert: Semi-Supervised Embedding Inversion Against Obfuscated Language Models

论文配图:DeepInvert: Semi-Supervised Embedding Inversion Against Obfuscated Language Models
图 1 · 摘自论文原文
  • 利用有标签数据训练+无标签数据一致性约束,实现半监督逆向攻击。
  • 对ObfusLM攻击达73.5%的准确率,远超此前26.2%的最好水平。
  • 揭示混淆防御的两难:保用则易被攻,保安全则失效,适合安全研究者参考。

云端语言模型服务常处理含敏感信息的提示词。基于混淆的防御机制(如ObfusLM、SentinelLMs、TextObfuscator、DPNR)在传输前变换提示表示,为密码方案提供轻量替代。本文揭示这些防御实际防护能力远低于预期。提出DeepInvert——一种半监督嵌入逆向攻击,可更准确地从混淆表示中恢复原始标记。核心洞察是:即便经过扰动,未标注的混淆嵌入仍保留可利用的语义结构。DeepInvert结合有标签影子数据的监督训练与针对未标注目标嵌入的新型无监督一致性目标,通过混合训练流程交替优化。防御感知适配进一步拓展攻击至编码器与自回归架构中的多种混淆机制。在九种防御、五类任务、四类模型架构上的实验表明,DeepInvert在多数防御下优于先前攻击。针对ObfusLM,其顶1恢复率达73.5%,远超此前最佳的26.2%。结果揭示任务依赖性矛盾:保留足够信号以维持功能的混淆方案也易被逆向,而抵抗逆向的方案则丧失实用性。在简单分类任务上,部分基于差分隐私的防御可兼顾两者。呼吁重新评估此类防御的有效性。

原文摘要 · Abstract (English)

Cloud-based language model services routinely process prompts containing sensitive information. Obfuscation-based defenses---including ObfusLM, SentinelLMs, TextObfuscator, and DPNR---mitigate this risk by transforming prompt representations before transmission, offering a lightweight alternative to cryptographic solutions. We show these defenses provide far less protection than previously believed. We present DeepInvert, a semi-supervised embedding inversion attack that recovers original tokens from obfuscated representations with higher accuracy than prior methods. The key insight is that unlabeled obfuscated embeddings retain exploitable semantic structure despite perturbation. DeepInvert combines supervised training on labeled shadow data with a novel unsupervised consistency objective over unlabeled target embeddings, alternating between the two via a mixed training pipeline. Defense-aware adaptations further extend the attack to diverse obfuscation mechanisms across encoder-based and autoregressive architectures. Experiments on nine defenses, five tasks, and four model architectures show that DeepInvert outperforms prior attacks on most defenses. Against ObfusLM, DeepInvert achieves 73.5\% top-1 token recovery versus 26.2\% for the previous best. Our results reveal a task-dependent tension: obfuscation schemes preserving enough signal for utility also retain sufficient structure for inversion, while schemes resisting inversion collapse utility. On simpler classification tasks, some DP-based defenses can maintain both. We call for a re-evaluation of this defense class.

嵌入逆向隐私保护语言模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。