提出可通用的预训练图压缩方法,摆脱对具体任务和模型的依赖。
Towards Pre-trained Graph Condensation via Optimal Transport
- 基于最优传输构建统一优化目标,统合理论框架
- 通过混合区间扩散增强节点状态不确定性,提升泛化能力
- 设计可追溯语义协调器,实现源图与压缩图间语义对齐
图压缩(GC)旨在将原始图压缩为小规模图,减少冗余并加速GNN训练。然而,传统方法严重依赖固定GNN结构和特定任务监督,限制了其在不同任务与架构间的复用性与泛化能力。本文从GNN优化一致性出发重新审视理想图压缩的目标,推导出一个广义的优化目标,使现有方法成为该范式的特例。在此基础上,提出基于最优传输的预训练图压缩(PreGC),突破任务与架构依赖。具体地,引入混合区间图扩散增强以抑制压缩图在特定架构上的弱泛化能力,通过建立最优图传输计划与表示传输计划之间的匹配,维持源图与压缩图空间的语义一致性。为进一步支持下游任务适配,设计可追溯的语义协调器,利用预训练中优化的表示传输路径连接源节点与压缩节点,实现语义关联桥接。大量实验验证了PreGC的优越性与通用性,证明其具备任务无关特性,并可无缝适配任意GNN架构。
原文摘要 · Abstract (English)
Graph condensation (GC) aims to distill the original graph into a small-scale graph, mitigating redundancy and accelerating GNN training. However, conventional GC approaches heavily rely on rigid GNNs and task-specific supervision. Such a dependency severely restricts their reusability and generalization across various tasks and architectures. In this work, we revisit the goal of ideal GC from the perspective of GNN optimization consistency, and then a generalized GC optimization objective is derived, by which those traditional GC methods can be viewed nicely as special cases of this optimization paradigm. Based on this, Pre-trained Graph Condensation (PreGC) via optimal transport is proposed to transcend the limitations of task- and architecture-dependent GC methods. Specifically, a hybrid-interval graph diffusion augmentation is presented to suppress the weak generalization ability of the condensed graph on particular architectures by enhancing the uncertainty of node states. Meanwhile, the matching between optimal graph transport plan and representation transport plan is tactfully established to maintain semantic consistencies across source graph and condensed graph spaces, thereby freeing graph condensation from task dependencies. To further facilitate the adaptation of condensed graphs to various downstream tasks, a traceable semantic harmonizer from source nodes to condensed nodes is proposed to bridge semantic associations through the optimized representation transport plan in pre-training. Extensive experiments verify the superiority and versatility of PreGC, demonstrating its task-independent nature and seamless compatibility with arbitrary GNNs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。