arXiv:2509.23816cs.LG2025-09中稿 · ICDM 2025被引 3

提出测试时评估动态图神经网络性能的新方法,解决模型部署后效果不可知问题。

Test-time GNN Model Evaluation on Dynamic Graphs

  • 通过两阶段框架模拟测试时动态图分布差异,训练评估器
  • 在分布偏移下准确估计多个DGNN模型在未见图上的性能
  • 适合关注模型可靠性与部署风险的工业界研究者

动态图神经网络(DGNN)已成为从动态图中学习的主流范式,广泛用于建模真实世界系统。然而,由于动态图数据分布随时间演变,已训练好的DGNN在实际部署中面对未见且无标签的测试图时,常面临显著性能不确定性。此时,在测试时评估已部署的DGNN性能至关重要,以判断其是否适用于未见的动态测试图。本文提出新研究问题:DGNN模型评估,旨在通过估计模型在未见动态图上的表现,评估特定训练好的DGNN在测试时的性能。为此,我们提出动态图神经网络评估器DyGEval,采用两阶段框架:(1) 测试时动态图仿真,捕捉训练-测试分布差异作为监督信号并训练评估器;(2) DyGEval开发与训练,精确估计预训练DGNN在测试时动态图上的性能。大量实验表明,所提DyGEval可有效评估多种DGNN骨干模型在不同动态图及分布偏移下的表现。

原文摘要 · Abstract (English)

Dynamic graph neural networks (DGNNs) have emerged as a leading paradigm for learning from dynamic graphs, which are commonly used to model real-world systems and applications. However, due to the evolving nature of dynamic graph data distributions over time, well-trained DGNNs often face significant performance uncertainty when inferring on unseen and unlabeled test graphs in practical deployment. In this case, evaluating the performance of deployed DGNNs at test time is crucial to determine whether a well-trained DGNN is suited for inference on an unseen dynamic test graph. In this work, we introduce a new research problem: DGNN model evaluation, which aims to assess the performance of a specific DGNN model trained on observed dynamic graphs by estimating its performance on unseen dynamic graphs during test time. Specifically, we propose a Dynamic Graph neural network Evaluator, dubbed DyGEval, to address this new problem. The proposed DyGEval involves a two-stage framework: (1) test-time dynamic graph simulation, which captures the training-test distributional differences as supervision signals and trains an evaluator; and (2) DyGEval development and training, which accurately estimates the performance of the well-trained DGNN model on the test-time dynamic graphs. Extensive experiments demonstrate that the proposed DyGEval serves as an effective evaluator for assessing various DGNN backbones across different dynamic graphs under distribution shifts.

图神经网络动态图模型评估测试时

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。