TTT让模型推理时自适应,却可能被攻击者突破安全防护。
Test-Time Training Undermines Safety Guardrails

- 在推理阶段动态调整参数,使模型易受攻击。
- 使用LoRA时,攻击成功率@10达93%~95%。
- 适合关注AI安全与对抗攻击的研究者。
测试时训练(TTT)是一种新兴范式,允许模型在推理过程中调整参数,提升少样本学习、检索增强生成和复杂推理等任务的表现。然而,这种动态适应引入了新漏洞,攻击者可利用其绕过安全过滤器。我们识别出三种TTT威胁模型,并证明攻击者可借此显著提升攻击成功率(ASR)及10次生成试验的平均攻击成功率(ASR@10)。例如,在LoRA设置下,少样本和生成阶段的威胁模型在不同模型家族与规模上平均实现ASR@10达95%和93%。这些漏洞可迁移至生产微调API。此外,TTT引发的过拟合会产生退化输出,导致标准评估中误判高攻击率,我们提出有效性感知评估加以修正。研究显示,TTT暴露了新攻击面,强化了攻击行为,削弱现有安全防护。作为初步防御,我们提出轻量级服务商端检测器,通过私有有害样本集上的困惑度变化识别TTT请求,但真正鲁棒部署仍需动态对齐机制。
原文摘要 · Abstract (English)
Test-Time Training (TTT) is an emerging paradigm that enables models to adapt their parameters during inference, improving performance on tasks such as few-shot learning, retrieval-augmented generation, and complex reasoning. However, this dynamic adaptation introduces new vulnerabilities that adversaries can exploit to jailbreak models. We identify three threat models for TTT and demonstrate how attackers can leverage them to bypass safety filters. Our results show that TTT can significantly increase the Attack Success Rate (ASR) and the ASR over 10 generation trials (ASR@10). For example, under LoRA, the few-shot and generation-phase threat models achieve an average ASR@10 of 95% and 93% respectively, across models from different families and scales. These vulnerabilities transfer to production fine-tuning APIs. We also show that TTT-induced overfitting can produce degenerate outputs that inflate ASR under standard judges, and propose a validity-aware evaluation to correct for this. Our findings suggest that TTT exposes a new attack surface, strengthens attacks, and undermines existing safety guardrails. As a first step toward defense, we propose a lightweight provider-side detector that flags TTT requests via the perplexity shift on a private harmful holdout, but robust deployment will ultimately require dynamic alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。