提出可加速图神经网络推理的图压缩方法,显著降低大图计算开销。
Inference-friendly Graph Compression for Graph Neural Networks
- 基于推理等价关系构建压缩方案,保留关键节点信息。
- 三种具体实现:结构保真、可调压缩比、特定节点保全,均保证推理质量。
- 适用于需要快速推理的大规模图任务,如社交网络分析。
图神经网络(GNN)在图分析中表现优异,但其推理过程成本高昂,限制了在大规模图上的应用。本文提出一种推理友好型图压缩(IFGC)方案,给定图 $G$ 和 GNN 模型 $M$,生成一个压缩图 $G_c$,使 $M$ 在 $G$ 上的推理结果可通过直接访问 $G_c$ 获得,几乎无需解压成本。首先,定义了一类推理等价关系,刻画在 GNN 推理中无法区分的节点对。其次,提出三种实际可操作的 IFGC 规范:结构保真压缩(SPGC),可直接用于 GNN 推理而无需解压;($α$, $r$)-压缩,支持压缩率与推理质量之间的可配置权衡;锚点压缩,专门保留某些目标节点的推理结果。每种方案均设计相应的压缩与推理算法,并提供效率与质量保障。在多个大规模图数据集上进行了广泛实验,验证了该方法的有效性与高效性。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have demonstrated promising performance in graph analysis. Nevertheless, the inference process of GNNs remains costly, hindering their applications for large graphs. This paper proposes inference-friendly graph compression (IFGC), a graph compression scheme to accelerate GNNs inference. Given a graph $G$ and a GNN $M$, an IFGC computes a small compressed graph $G_c$, to best preserve the inference results of $M$ over $G$, such that the result can be directly inferred by accessing $G_c$ with no or little decompression cost. (1) We characterize IFGC with a class of inference equivalence relation. The relation captures the node pairs in $G$ that are not distinguishable for GNN inference. (2) We introduce three practical specifications of IFGC for representative GNNs: structural preserving compression (SPGC), which computes $G_c$ that can be directly processed by GNN inference without decompression; ($α$, $r$)-compression, that allows for a configurable trade-off between compression ratio and inference quality, and anchored compression that preserves inference results for specific nodes of interest. For each scheme, we introduce compression and inference algorithms with guarantees of efficiency and quality of the inferred results. We conduct extensive experiments on diverse sets of large-scale graphs, which verifies the effectiveness and efficiency of our graph compression approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。