提出ROBAD模型,提升对恶意用户检测的抗攻击能力。
ROBAD: Robust Adversary-aware Local-Global Attended Bad Actor Detection Sequential Model
- 结合局部与全局注意力机制,分析用户发帖内容与序列模式。
- 在对抗攻击下仍保持高检测准确率,优于现有方法。
- 适合需要抵御伪装攻击的平台安全系统使用。
识别恶意用户对保障互联网平台安全至关重要。现有深度学习模型虽能检测恶意用户,但对输入序列的微小改动敏感,缺乏鲁棒性。为此,本文提出ROBAD(RObust adversary-aware local-global attended Bad Actor Detection model),一种基于Transformer的分类模型。该模型首先通过编码器双向编码每条帖子,生成局部语义嵌入;再通过解码器利用注意力机制建模帖子嵌入序列,获得全局上下文信息;最后引入对抗性修改样本进行对比学习,增强模型对潜在攻击行为的识别能力。实验在Yelp和Wikipedia数据集上验证,ROBAD在多种前沿对抗攻击下仍能有效检测恶意用户,显著提升鲁棒性。
原文摘要 · Abstract (English)
Detecting bad actors is critical to ensure the safety and integrity of internet platforms. Several deep learning-based models have been developed to identify such users. These models should not only accurately detect bad actors, but also be robust against adversarial attacks that aim to evade detection. However, past deep learning-based detection models do not meet the robustness requirement because they are sensitive to even minor changes in the input sequence. To address this issue, we focus on (1) improving the model understanding capability and (2) enhancing the model knowledge such that the model can recognize potential input modifications when making predictions. To achieve these goals, we create a novel transformer-based classification model, called ROBAD (RObust adversary-aware local-global attended Bad Actor Detection model), which uses the sequence of user posts to generate user embedding to detect bad actors. Particularly, ROBAD first leverages the transformer encoder block to encode each post bidirectionally, thus building a post embedding to capture the local information at the post level. Next, it adopts the transformer decoder block to model the sequential pattern in the post embeddings by using the attention mechanism, which generates the sequence embedding to obtain the global information at the sequence level. Finally, to enrich the knowledge of the model, embeddings of modified sequences by mimicked attackers are fed into a contrastive-learning-enhanced classification layer for sequence prediction. In essence, by capturing the local and global information (i.e., the post and sequence information) and leveraging the mimicked behaviors of bad actors in training, ROBAD can be robust to adversarial attacks. Extensive experiments on Yelp and Wikipedia datasets show that ROBAD can effectively detect bad actors when under state-of-the-art adversarial attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。