用低秩适配器检测模型隐藏后门,不依赖触发数据也能定位并修复。
LoRA as Oracle
- 通过低秩适配器分析模型内部表征与行为的差异来识别后门
- 在4个数据集上精准定位后门,修复时保留干净准确率且成本极低
- 适合需要安全审计但无训练数据的场景,尤其擅长无触发数据检测
实践中越来越多的用户部署未亲自训练的神经网络,需在事后审计其是否存在隐藏后门,但缺乏训练流程、污染数据或触发条件信息。本文提出一种基于低秩适配器的审计视角:模型内化内容与其行为表现是两个可分离的维度。通过向某一假设拟合小规模低秩适配器,并分析更新后的几何特性——能量大小及其与冻结权重的对齐程度——可直接度量内化程度,独立于输出行为。当两者出现偏差时,该视角尤为有效:后门即为恶意内化,是一种学习到的触发-目标捷径,常规行为审计可能忽略。利用此方法,可在无任何触发数据、不依赖目标类别标签的情况下,识别出具有清晰内化特征的后门,并在同一低秩子空间中删除该捷径,检测置信度与修复规模直接相关。在四个数据集和四种架构上,该方法在同类威胁模型下是最一致的目标识别者;其秩-r修复能清除后门,同时保持原始准确率,而全模型基线则严重退化;且唯一能既消除后门又确保模型仍为良性,因可在不确定时选择不操作。
原文摘要 · Abstract (English)
Practitioners increasingly deploy neural networks they did not train, and must audit them after the fact for hidden backdoors, without the training pipeline, the poisoned data, or knowledge of any trigger. We introduce a low-rank auditing lens built on a single observation: what a model has internalized and how it behaves are distinct axes that can diverge. Fitting a small low-rank adapter toward a hypothesis and reading the geometry of the resulting update, its energy relative to, and its alignment with, the frozen weights, measures internalization directly, independently of the model's output behavior. The lens earns its value where the two axes diverge: a backdoor is malicious internalization, a learned trigger-to-target shortcut, that behavioral auditing can miss. Reading it, we identify the backdoor's target class label-free and without any triggered data when the backdoor leaves a legible internalization signature, then erase the identified shortcut within the same low-rank subspace, uniquely coupling detection confidence to the size of the repair. Across four datasets and four architectures, our lens is the most consistent target identifier among defenses in its threat model; its rank-r repair removes backdoors while preserving clean accuracy where full-model baselines collapse it, at orders-of-magnitude lower parameter and memory cost; and it is the only method that both erases the backdoor and leaves a benign model intact, because it can decline to act when uncertain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。