攻击图模型共享表征层,发现其存在可被利用的脆弱性。
Attacking Graph Foundation Models Through Their Shared Representation

- 针对图基础模型的共享表征层设计推理时攻击,无需训练数据。
- 仅需相当于普通图网络的扰动预算,即可使六类模型全部崩溃。
- 发现开放图模型在频谱分词器下更脆弱,揭示了表征层特有风险。
图基础模型通过将输入映射到统一的共享表征空间来实现跨领域泛化,该映射过程称为对齐层,是图基础模型与传统图神经网络的关键区别。本文首次揭示该对齐层是未被研究的新型攻击面。我们在无训练访问的前提下,对六种公开模型(涵盖频谱分词器、文本嵌入空间及离散码本)进行推理时攻击。定向的表征空间扰动可在与普通图网络相当的扰动预算下导致所有模型崩溃;其中OpenGraph模型的频谱分词器在五分之一预算下即失效,表现出纯图网络不具备的对齐层特异性脆弱性,该现象由同表示控制实验归因于分词器而非解码器。一种可实现的输入空间攻击(编辑边、特征或文本)在峰值时能消除至少一半正确预测,在三类模型上效果显著。攻击实效性与解码器读取表征的直接程度相关,而非任务干净准确率;我们通过解码器局部Lipschitz敏感性结构化度量‘载体增益’,并发现干净准确率头余作为模型内排序启发式在真实攻击下不成立。
原文摘要 · Abstract (English)
A graph foundation model generalizes across graph domains by mapping every input into one shared representation before any task reasoning. We call this map the alignment layer, the component that separates a graph foundation model from a graph neural network, and we show it is a distinct attack surface that prior work has not studied. We attack it at inference time, with no access to training, on six public models spanning spectral tokenizers, text embedding spaces, and a discrete codebook. A directed representation-space perturbation collapses every model, but at a budget comparable to the representation norm a plain graph network also needs, with one exception: OpenGraph, whose spectral tokenizer collapses at a fifth of that budget, an alignment-specific fragility a plain network does not share and which a same-representation control traces to the tokenizer rather than the decoder. A realizable input-space attack that edits edges, features, or text removes at least half the correct predictions on three of the six models at peak. How much of this fragility an input-access attacker realizes tracks how directly the decoder reads the representation, and not the clean accuracy a task leaves; we measure this carrier gain structurally from the decoder's local Lipschitz sensitivity, and report clean-accuracy headroom as a within-model ordering heuristic that does not survive on realizable attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。