为无线信号分类的Transformer模型设计了抗攻击的指示令牌机制。
Vision Transformer with Adversarial Indicator Token against Adversarial Attacks in Radio Signal Classifications
- 引入对抗性指示令牌,动态检测输入中的异常特征。
- 在白盒攻击下优于FGSM、PGD等方法,准确率提升显著。
- 兼顾训练与运行时防御,无需额外检测模型,结构更简洁。
Transformer在自然语言处理和计算机视觉等领域取得巨大成功,推动其在物联网设备通信系统中自动调制分类的应用。然而,基于Transformer的无线信号分类易受细微但复杂的对抗攻击影响。为此,本文提出一种新型视觉变压器(ViT)架构,通过引入对抗性指示(AdvI)令牌来检测对抗攻击。据我们所知,这是首个在ViT中使用AdvI令牌防御对抗攻击的工作。将对抗训练与基于AdvI令牌的检测机制结合,在统一神经网络中实现训练时与运行时双重防御,相比使用独立模型检测扰动,显著降低系统架构复杂度。通过分析注意力机制,揭示了所提的AdvI令牌作为关键组件,能调节注意力权重,突出输入数据中可疑或异常的区域或特征。实验表明,该方法在白盒攻击场景下,包括快速梯度法(FGSM)、投影梯度下降(PGD)和基本迭代法(BIM)等攻击中,均优于多个对比方法。
原文摘要 · Abstract (English)
The remarkable success of transformers across various fields such as natural language processing and computer vision has paved the way for their applications in automatic modulation classification, a critical component in the communication systems of Internet of Things (IoT) devices. However, it has been observed that transformer-based classification of radio signals is susceptible to subtle yet sophisticated adversarial attacks. To address this issue, we have developed a defensive strategy for transformer-based modulation classification systems to counter such adversarial attacks. In this paper, we propose a novel vision transformer (ViT) architecture by introducing a new concept known as adversarial indicator (AdvI) token to detect adversarial attacks. To the best of our knowledge, this is the first work to propose an AdvI token in ViT to defend against adversarial attacks. Integrating an adversarial training method with a detection mechanism using AdvI token, we combine a training time defense and running time defense in a unified neural network model, which reduces architectural complexity of the system compared to detecting adversarial perturbations using separate models. We investigate into the operational principles of our method by examining the attention mechanism. We show the proposed AdvI token acts as a crucial element within the ViT, influencing attention weights and thereby highlighting regions or features in the input data that are potentially suspicious or anomalous. Through experimental results, we demonstrate that our approach surpasses several competitive methods in handling white-box attack scenarios, including those utilizing the fast gradient method, projected gradient descent attacks and basic iterative method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。