arXiv:2512.14751cs.CRcs.AI2025-12中稿 · the ACM SIGSAC Con…被引 1

微调模型会继承预训练模型的越狱漏洞,且漏洞可被高效利用。

One Leak Away: How Pretrained Model Exposure Amplifies Jailbreak Risks in Finetuned LLMs

  • 通过分析预训练到微调的迁移路径,发现攻击提示能有效跨模型传递。
  • 在多个模型和任务上,新提出的PGP攻击成功率超90%。
  • 研究揭示了漏洞继承机制,适合安全评估与防御设计人员参考。

微调预训练大语言模型已成为下游应用开发的标准范式,但其安全风险仍不明确,尤其是微调模型是否会继承预训练源的越狱漏洞。我们在此前训练到微调的威胁模型下进行研究,攻击者可访问公开发布的预训练模型,但无法获取专有的微调衍生模型。实证分析表明,针对预训练模型优化的对抗性提示能最有效地迁移到其微调版本,揭示了从预训练到微调的漏洞继承现象。通过表示层探查发现,可迁移提示在预训练隐藏状态中具有线性可分性,表明迁移相关结构已编码于预训练表示中。基于此,我们提出探针引导投影(PGP)攻击,引导优化聚焦于可迁移方向。在多个大模型家族和多样微调任务上的实验验证了PGP的强大迁移能力,凸显了预训练到微调范式中的固有安全风险。最后,我们证明相同表示层洞察可用于构建轻量级防御,有效缓解预训练到微调的越狱迁移,同时保持下游任务性能。

原文摘要 · Abstract (English)

Finetuning pretrained large language models (LLMs) has become the standard paradigm for developing downstream applications. However, its security implications remain unclear, particularly regarding whether finetuned LLMs inherit jailbreak vulnerabilities from their pretrained sources. We investigate this question in a realistic pretrain-to-finetune threat model, where an attacker has full access to a released pretrained LLM but no access to its proprietary finetuned derivatives. Empirical analysis shows that adversarial prompts optimized on the pretrained model transfer most effectively to its finetuned variants, revealing inherited vulnerabilities from pretrained to finetuned LLMs. To further examine this inheritance, we conduct representation-level probing, which shows that transferable prompts are linearly separable within the pretrained hidden states, suggesting that transferability-relevant structure is already encoded in pretrained representations. Building on this insight, we propose the Probe-Guided Projection (PGP) attack, which steers optimization toward transferability-relevant directions. Experiments across multiple LLM families and diverse finetuned tasks confirm PGP's strong transfer success, underscoring the security risks inherent in the pretrain-to-finetune paradigm. Finally, we demonstrate that the same representation-level insights also enable a lightweight defense that mitigates pretrain-to-finetune jailbreak transfer while preserving downstream utility.

越狱攻击模型安全微调风险

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。