提出新型攻击方法CrACK,破坏多模型协作中的语义一致性。
CrACK: Adversarial Attacks on Cross-Model Consistency in Collaborative Vision Foundation Models

- 通过篡改跨模型特征关联性,在不修改输入的前提下发起攻击
- 使协同系统崩溃,而各单模型输出仍看似正常
- 揭示多模型协作系统的安全边界需重新审视
无需训练的协作式视觉基础模型(如CLIP、SAM、DINO)在开放词汇密集预测中表现强劲,并被广泛部署于关键应用。当前普遍认为其安全性源于各模型自身的鲁棒性,我们对此提出质疑。我们发现所有协作管道共有的漏洞:各模型直接使用另一模型的中间输出却未验证语义一致性,这一未验证前提称为语义-空间对齐依赖。现有对抗攻击针对单个模型,忽视此前提,导致模型间接口完全无防护。我们提出CrACK(跨模型一致性对抗攻击),一种推理时攻击,不修改输入像素、模型权重或训练数据。该攻击分两阶段:对抗亲和力矛盾注入通过引导CLIP的图像块语义反转SAM编码器特征,破坏跨模态亲和矩阵;语义接口污染则基于CLIP文本嵌入生成最大距离标签排列,操控预测结果。在八个基准上的四个协作管道实验表明,CrACK导致灾难性性能下降,而各模型独立输出保持不变,使基于单模型的防御失效。该污染进一步蔓延至大视觉语言模型推理,使LLaVA在视觉完整输入下产生错误响应。结果表明,协作AI系统的安全不能简化为组件鲁棒性,模型间特征接口必须作为第一优先级的安全边界。
原文摘要 · Abstract (English)
Training-free collaborative pipelines that integrate Vision Foundation Models such as CLIP, SAM, and DINO achieve strong open-vocabulary dense prediction and are increasingly deployed in safety-critical applications. The security of these systems is commonly assumed to follow from the robustness of their individual models. We challenge this assumption. We identify a vulnerability shared by every collaborative pipeline: each model consumes the intermediate output of another without verifying semantic consistency, an unverified premise that we term the semantic-spatial alignment dependency. Existing adversarial attacks target a single model and overlook this premise, leaving the inter-model interface entirely unguarded. We propose CrACK (Cross-model Adversarial Consistency attack), an inference-time attack that exploits this interface without modifying any input pixel, model weight, or training data. CrACK operates in two stages: Adversarial Affinity Contradiction Injection corrupts the cross-modal affinity matrix by inverting SAM encoder features under the guidance of CLIP patch-level semantics, and Semantic Interface Poisoning steers the prediction through a max-distance label permutation derived from CLIP text embeddings. Experiments on four collaborative pipelines across eight benchmarks show that CrACK causes catastrophic degradation while every individual model continues to produce its unchanged standalone output, rendering per-model defenses structurally blind. The corruption further cascades into large vision-language model reasoning, driving models such as LLaVA to produce erroneous responses from visually intact inputs. Our results show that the security of a collaborative AI system cannot be reduced to the robustness of its components, and that inter-model feature interfaces must be treated as first-class security boundaries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。