黑客把有害内容藏进图片,让AI看不懂却能被人类看到。
Making MLLMs Blind: Adversarial Smuggling Attacks in MLLM Content Moderation
- 用视觉伪装技术把有害信息藏在可读图中,绕过AI审查
- 测试显示主流模型攻击成功率超90%,漏洞普遍存在
- 适合关注AI安全、内容审核的开发者和研究者
多模态大语言模型(MLLM)正被广泛用于自动化内容审核。我们发现一种新型威胁:对抗性走私攻击。与导致误分类的对抗扰动或引发有害输出的越狱攻击不同,走私攻击利用人机能力差,将有害内容编码为人类可读但AI无法识别的视觉形式,从而绕过自动检测并传播有害信息。我们将其分为两类:(1) 感知盲区,破坏文本识别;(2) 推理阻断,虽识别出文字但无法理解语义。为此我们构建了首个全面基准SmuggleBench,包含1,700个对抗性走私攻击实例。评估显示,包括GPT-5和Qwen3-VL在内的主流模型均易受此攻击,攻击成功率(ASR)超过90%。通过分析感知与推理层面的脆弱性,我们识别出三大根源:视觉编码器能力有限、OCR鲁棒性不足,以及领域特定对抗样本稀缺。我们初步探索了缓解策略,考察了测试时缩放(通过CoT)和对抗训练(通过SFT)的潜力。代码已公开于https://github.com/zhihengli-casia/smugglebench。
原文摘要 · Abstract (English)
Multimodal Large Language Models (MLLMs) are increasingly being deployed as automated content moderators. Within this landscape, we uncover a critical threat: Adversarial Smuggling Attacks. Unlike adversarial perturbations (for misclassification) and adversarial jailbreaks (for harmful output generation), adversarial smuggling exploits the Human-AI capability gap. It encodes harmful content into human-readable visual formats that remain AI-unreadable, thereby evading automated detection and enabling the dissemination of harmful content. We classify smuggling attacks into two pathways: (1) Perceptual Blindness, disrupting text recognition; and (2) Reasoning Blockade, inhibiting semantic understanding despite successful text recognition. To evaluate this threat, we constructed SmuggleBench, the first comprehensive benchmark comprising 1,700 adversarial smuggling attack instances. Evaluations on SmuggleBench reveal that both proprietary (e.g., GPT-5) and open-source (e.g., Qwen3-VL) state-of-the-art models are vulnerable to this threat, producing Attack Success Rates (ASR) exceeding 90%. By analyzing the vulnerability through the lenses of perception and reasoning, we identify three root causes: the limited capabilities of vision encoders, the robustness gap in OCR, and the scarcity of domain-specific adversarial examples. We conduct a preliminary exploration of mitigation strategies, investigating the potential of test-time scaling (via CoT) and adversarial training (via SFT) to mitigate this threat. Our code is publicly available at https://github.com/zhihengli-casia/smugglebench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。