发现视觉Transformer中后门攻击的特定激活方向,可诊断并检测隐蔽后门。
Backdoor Directions in Vision Transformers
- 通过触发器方向定位模型内部后门表征,实现对攻击机制的可视化
- 静态补丁与分布式触发器在内部处理逻辑上存在本质差异
- 提出无需数据的权重检测方法,适用于隐蔽后门攻击
本文研究视觉变换器(ViTs)中后门攻击的内在表示。在已知触发器的前提下,我们识别出模型激活中对应于触发器内部表示的特定“触发方向”。通过在激活和参数空间进行干预,证实该线性方向具有因果作用,能在多个数据集和攻击类型下一致调节模型的后门行为。利用该方向作为诊断工具,我们追踪后门特征在各层的处理过程。分析揭示:静态补丁触发器与隐蔽的分布式触发器遵循不同的内部逻辑。进一步探究后门与对抗攻击的关系,测试基于PGD的扰动是否能(去)激活该触发机制。最后,提出一种无需数据、基于权重的检测方案,用于防御隐蔽触发器攻击。研究结果表明,机制可解释性为诊断和应对计算机视觉安全漏洞提供了稳健框架。
原文摘要 · Abstract (English)
This paper investigates how Backdoor Attacks are represented within Vision Transformers (ViTs). By assuming knowledge of the trigger, we identify a specific ``trigger direction'' in the model's activations that corresponds to the internal representation of the trigger. We confirm the causal role of this linear direction by showing that interventions in both activation and parameter space consistently modulate the model's backdoor behavior across multiple datasets and attack types. Using this direction as a diagnostic tool, we trace how backdoor features are processed across layers. Our analysis reveals distinct qualitative differences: static-patch triggers follow a different internal logic than stealthy, distributed triggers. We further examine the link between backdoors and adversarial attacks, specifically testing whether PGD-based perturbations (de-)activate the identified trigger mechanism. Finally, we propose a data-free, weight-based detection scheme for stealthy-trigger attacks. Our findings show that mechanistic interpretability offers a robust framework for diagnosing and addressing security vulnerabilities in computer vision.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。