通过对抗博弈检测模型隐藏有害行为,有效识别被污染的AI模型。
Who's the Evil Twin? Differential Auditing for Undesired Behavior
- 构建红蓝两队对抗:红队训练相似但有隐含有害行为的模型。
- 基于对抗攻击的方法在有提示时实现100%准确识别。
- LLM审计需先验提示,适合安全评估与模型可解释性研究者。
由于缺乏先验知识及潜在的对抗混淆,检测神经网络中的隐藏行为极具挑战。本文将检测问题建模为一场对抗博弈:红队训练两个相似模型,一个仅用良性数据训练,另一个则包含隐蔽有害行为,两者在良性数据集上表现几乎无法区分;蓝队在有限或无信息条件下尝试识别出受污染的模型。我们使用CNN进行实验,测试了高斯噪声分析、模型差异比较、积分梯度和不同提示水平下的对抗攻击等多种蓝队策略。结果表明,基于对抗攻击的方法在获得提示时可实现100%正确预测,表现极为出色,而其他方法结果差异较大。在针对大语言模型(LLM)的实验中,发现难以直接复用CNN阶段的方法。相反,有效的LLM审计需要关于不良行为分布的一些提示,这些提示可用于标准黑盒与开源权重方法,进一步探测模型并揭示其对齐偏差。我们开源了整个审计游戏(含模型与数据),期望推动更优审计机制的设计。
原文摘要 · Abstract (English)
Detecting hidden behaviors in neural networks poses a significant challenge due to minimal prior knowledge and potential adversarial obfuscation. We explore this problem by framing detection as an adversarial game between two teams: the red team trains two similar models, one trained solely on benign data and the other trained on data containing hidden harmful behavior, with the performance of both being nearly indistinguishable on the benign dataset. The blue team, with limited to no information about the harmful behaviour, tries to identify the compromised model. We experiment using CNNs and try various blue team strategies, including Gaussian noise analysis, model diffing, integrated gradients, and adversarial attacks under different levels of hints provided by the red team. Results show high accuracy for adversarial-attack-based methods (100\% correct prediction, using hints), which is very promising, whilst the other techniques yield more varied performance. During our LLM-focused rounds, we find that there are not many parallel methods that we could apply from our study with CNNs. Instead, we find that effective LLM auditing methods require some hints about the undesired distribution, which can then used in standard black-box and open-weight methods to probe the models further and reveal their misalignment. We open-source our auditing games (with the model and data) and hope that our findings contribute to designing better audits.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。