通过训练步数验证机制,提前发现大模型训练中的后门攻击。
PoTS: Proof-of-Training-Steps for Backdoor Detection in Large Language Models
- 基于语言建模头对扰动的敏感性分析,验证训练过程合规性。
- 即使训练数据10%含触发器,也能显著降低攻击成功率。
- 支持训练中早期检测,验证速度是训练的3倍,适合审计场景。
随着大语言模型在关键领域广泛应用,确保训练过程的安全与可信成为重大挑战。后门攻击通过在训练数据中注入隐藏触发器,极具隐蔽性且难以察觉。现有事后验证方法如Proof-of-Learning因需完整重训、对隐蔽篡改不鲁棒、无法实现训练期间早期检测而难以应用于大模型。为此,我们提出Proof-of-Training Steps验证协议,使独立审计者(Alice)可确认开发者(Bob)是否遵循声明的训练方案,包括数据批次、模型架构与超参数。通过分析大模型语言建模头(LM-Head)对输入扰动的敏感性,该方法能暴露细微的后门注入或训练偏差。即使训练数据中高达10%包含后门触发器,本协议仍显著削弱攻击者实现高攻击成功率(ASR)的能力。该方法可在注入阶段实现早期检测,验证步骤耗时仅为训练步骤的3倍。结果表明,该协议极大提升了大模型开发的可问责性与安全性,尤其适用于防范内部威胁。
原文摘要 · Abstract (English)
As Large Language Models (LLMs) gain traction across critical domains, ensuring secure and trustworthy training processes has become a major concern. Backdoor attacks, where malicious actors inject hidden triggers into training data, are particularly insidious and difficult to detect. Existing post-training verification solutions like Proof-of-Learning are impractical for LLMs due to their requirement for full retraining, lack of robustness against stealthy manipulations, and inability to provide early detection during training. Early detection would significantly reduce computational costs. To address these limitations, we introduce Proof-of-Training Steps, a verification protocol that enables an independent auditor (Alice) to confirm that an LLM developer (Bob) has followed the declared training recipe, including data batches, architecture, and hyperparameters. By analyzing the sensitivity of the LLMs' language modeling head (LM-Head) to input perturbations, our method can expose subtle backdoor injections or deviations in training. Even with backdoor triggers in up to 10 percent of the training data, our protocol significantly reduces the attacker's ability to achieve a high attack success rate (ASR). Our method enables early detection of attacks at the injection step, with verification steps being 3x faster than training steps. Our results highlight the protocol's potential to enhance the accountability and security of LLM development, especially against insider threats.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。