arXiv:2511.19569cs.LG2025-11AAAI被引 2

提出新视角破解语言模型反演,提升隐私泄露风险评估能力

An Invariant Latent Space Perspective on Language Model Inversion

  • 将语言模型反演视为利用其自身潜在空间的不变性重构输入
  • 在9个数据集上平均提升4.77% BLEU得分,减少对大规模语料依赖
  • 适合研究模型安全与隐私保护的学者,可作为攻击基准

语言模型反演(LMI)——从输出中恢复隐藏提示——已成为用户隐私与系统安全的实际威胁。本文将LMI重新建模为复用大语言模型自身潜在空间,并提出不变潜在空间假设(ILSH):(1) 同一源提示生成的多样化输出应保持语义一致(源不变性);(2) 输入与输出间的循环映射应在共享潜在空间中自洽(循环不变性)。据此,我们提出Inv^2A,将语言模型视为不变解码器,仅学习轻量级逆编码器,将输出映射至去噪伪表示。当有多个输出时,通过稀疏拼接表示层提升信息密度。训练分两阶段:对比对齐(源不变性)与监督强化(循环不变性)。可选的免训练邻域搜索进一步优化局部性能。在涵盖用户与系统提示场景的9个数据集上,Inv^2A平均提升4.77% BLEU分数,同时降低对大型逆向语料库的依赖。分析表明,现有防御措施保护效果有限,亟需更强策略。源代码与数据见https://github.com/yyy01/Invariant_Attacker。

原文摘要 · Abstract (English)

Language model inversion (LMI), i.e., recovering hidden prompts from outputs, emerges as a concrete threat to user privacy and system security. We recast LMI as reusing the LLM's own latent space and propose the Invariant Latent Space Hypothesis (ILSH): (1) diverse outputs from the same source prompt should preserve consistent semantics (source invariance), and (2) input<->output cyclic mappings should be self-consistent within a shared latent space (cyclic invariance). Accordingly, we present Inv^2A, which treats the LLM as an invariant decoder and learns only a lightweight inverse encoder that maps outputs to a denoised pseudo-representation. When multiple outputs are available, they are sparsely concatenated at the representation layer to increase information density. Training proceeds in two stages: contrastive alignment (source invariance) and supervised reinforcement (cyclic invariance). An optional training-free neighborhood search can refine local performance. Across 9 datasets covering user and system prompt scenarios, Inv^2A outperforms baselines by an average of 4.77% BLEU score while reducing dependence on large inverse corpora. Our analysis further shows that prevalent defenses provide limited protection, underscoring the need for stronger strategies. The source code and data involved in this paper can be found in https://github.com/yyy01/Invariant_Attacker.

模型安全反演攻击潜在空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。