arXiv:2606.31309cs.CRcs.AI2026-06

提出新方法检测和还原大模型后门,无需黑名单也能精准识别恶意触发词。

CSO-LLM: Class Subspace Orthogonalization for Post-Training Backdoor Detection and Trigger Inversion in LLMs

论文配图:CSO-LLM: Class Subspace Orthogonalization for Post-Training Backdoor Detection and Trigger Inversion in LLMs
图 1 · 摘自论文原文
  • 通过类别子空间正交化技术,提升检测灵敏度与特异性。
  • 在多个模型架构上实现高精度后门检测与真实触发词还原。
  • 适合关注大模型安全、后门防御的研究者和工程师使用。

尽管针对图像类AI的后训练后门检测与触发词反演方法已有发展,但适用于大语言模型(LLMs)的方法仍十分稀缺。首先,LLM输入空间为离散,需考虑最多达150,000^k个可能的k元组组合(k为潜在触发词长度)。其次,必须屏蔽攻击目标类别的典型响应词,否则会引发误报。然而,通用领域通常缺乏完整黑名单。本文提出一种高效检测与反演框架,将LLM视为分类器。核心是类别子空间正交化(CSO),一种可即插即用的新型后门检测范式,在应用于LLM时具有双重作用:其一,显著提升基线检测器的敏感性与特异性;其二,实现隐式黑名单功能,通过惩罚那些在方向上诱导目标类别信号扰动的词汇进入候选触发词。一个版本在词嵌入空间进行连续优化,另一版本则在离散词空间中采用贪心扩展法进行触发词反演与检测。实验表明,该方法在多个分类任务及不同大模型架构上均实现了强检测性能与真实触发词的准确还原。

原文摘要 · Abstract (English)

While post-training backdoor detection and trigger inversion schemes have been developed for AIs used e.g. for images, there is a paucity of such methods for LLMs. First, the LLM input space is discrete, with up to 150,000^k k-tuples to consider with k the token-length of a putative trigger. Second, one must blacklist tokens typical of the putative target response (class) of an attack, as such tokens may give false detection signals. However, a comprehensive blacklist is not available, in general, for a given domain. We develop a highly effective detection and inversion framework for LLMs treated as classifiers. Central to our approach is class subspace orthogonalization (CSO), a novel plug-and-play paradigm for backdoor detection that serves two fundamental roles when applied to LLMs: i) it enhances both sensitivity and specificity of a baseline detector; ii) it provides a form of implicit blacklisting, as it penalizes against inclusion, in a candidate trigger, of tokens that induce signal perturbations "in the direction of" the putative target class of an attack. One version of our detector performs continuous optimization in token embedding space, while a companion trigger-inversion and detection method performs greedy accretion in discrete token space. Our methods give both strong detection performance and accurate inversion of ground-truth triggers on several LLM classification domains, and for several different LLM architectures.

后门检测大模型安全触发词还原LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。