提出可保证性能的图数据采样方法,让小样本训练效果接近全量数据。
Subsampling Graphs with GNN Performance Guarantees
- 基于树移动距离设计新采样策略,同时减少图数量和单个图大小
- 理论证明采样后模型损失增长有界,性能不会大幅下降
- 无需标签且不依赖模型结构,适合早期数据筛选阶段
如何对图数据进行采样,使在子集上训练的图神经网络(GNN)性能接近全量数据训练?这在降低标注成本、存储开销和计算资源方面具有根本意义。选择有效子集极具挑战:不当采样会严重损害模型性能,而逐一测试多个子集则失去了采样的优势。因此,采样必须具备性能保障。本文提出新的图数据采样方法,利用树移动距离(Tree Mover's Distance)同时减少图的数量与单个图的规模。据我们所知,这是首个具有严格理论保证的方法:证明在子样本上训练的GNN,其损失增加是有限的。与现有方法不同,本方法既模型无关(无需假设GNN结构),也标签无关(无需标注全量数据)。这使得采样可提前至模型开发初期(数据标注前、模型选择与超参调优前),显著降低存储、标注与训练资源开销。实验验证了理论结果,表明该方法在多个数据集上优于现有采样方法。
原文摘要 · Abstract (English)
How can we subsample graph data so that a graph neural network (GNN) trained on the subsample achieves performance comparable to training on the full dataset? This question is of fundamental interest, as smaller datasets reduce labeling costs, storage requirements, and computational resources needed for training. Selecting an effective subset is challenging: a poorly chosen subsample can severely degrade model performance, and empirically testing multiple subsets for quality obviates the benefits of subsampling. Therefore, it is critical that subsampling comes with guarantees on model performance. In this work, we introduce new subsampling methods for graph datasets that leverage the Tree Mover's Distance to reduce both the number of graphs and the size of individual graphs. To our knowledge, our approach is the first that is supported by rigorous theoretical guarantees: we prove that training a GNN on the subsampled data results in a bounded increase in loss compared to training on the full dataset. Unlike existing methods, our approach is both model-agnostic, requiring minimal assumptions about the GNN architecture, and label-agnostic, eliminating the need to label the full training set. This enables subsampling early in the model development pipeline (before data annotation, model selection, and hyperparameter tuning) reducing costs and resources needed for storage, labeling, and training. We validate our theoretical results with experiments showing that our approach outperforms existing subsampling methods across multiple datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。