揭示GNN-KGQA中子图构建是主要脆弱环节,而非推理模型。
Query-Side Attacks on GNN-Based KGQA: Tracing Failures from Entity Linking to Answer Generation

- 设计隔离阶段的对抗扰动方法,定位故障源头。
- 子图构建失误导致99%以上端到端性能下降,即使答案在子图中存在。
- 适合关注KGQA安全与可解释性的研究人员使用。
基于图神经网络的知识图谱问答(GNN-based KGQA)流程包含实体链接、子图检索、GNN推理和答案生成四个阶段。传统鲁棒性评估将各阶段失败混为一端到端指标,掩盖了脆弱性来源。本文通过两个保持答案不变的对抗扰动——组合重构(CR)与关系同义替换(RS),在ComplexWebQuestions和WebQSP数据集上验证,发现当子图完整时GNN推理阶段准确率接近基线,而子图构建阶段导致超过99%的端到端性能崩溃。即使在74%的检索子图中包含正确答案,仍无法被有效利用,暴露出答案存在与可达性的根本差异。这表明应将防御重点放在子图构建而非推理模型。相关扰动数据集与评估框架已公开。
原文摘要 · Abstract (English)
GNN-based Knowledge Graph Question Answering (KGQA) pipelines process queries through four discrete stages: entity linking, subgraph retrieval, GNN reasoning, and answer generation. Standard robustness evaluations conflate stage-level failures into a single end-to-end metric, obscuring both the source of brittleness and the appropriate mitigation target. We ask which stage fails, and why, when the pipeline is subjected to adversarial perturbations on the input question. We introduce a stage-isolation protocol with two answer-preserving adversarial perturbations verified against the knowledge graph: Compositional Restructuring (CR) and Relation Synonym Swap (RS) target distinct stages while leaving entity seeds intact. Evaluated across ComplexWebQuestions and WebQSP, the results run counter to prevailing assumptions: the GNN reasoning stage retains near-baseline accuracy when the subgraph is intact, while subgraph construction accounts for over 99\% of the end-to-end collapse under CR, occurring even when the gold answer is present in 74\% of retrieved subgraphs. This exposes a fundamental distinction between answer presence and answer reachability that end-to-end metrics cannot detect, and places the mitigation target firmly at the subgraph construction stage rather than the reasoning model. Perturbed datasets and evaluation infrastructure are released at https://anonymous.4open.science/r/atkgrag-E85C .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。