提出评估动态图嵌入质量的新标准,让模型更真实反映网络变化。
Representation Integrity in Temporal Graph Learning Methods
- 定义'表示完整性'并设计可量化指标,跟踪嵌入随图结构变化的匹配度。
- 42个指标筛选后推荐一个最优,与稳定模型排名一致且预测性能相关。
- 适合关注动态图模型可靠性、想超越任务特定评估的研究者使用。
从航空路线到加密货币交易,现实世界系统常以随时间演化的动态图建模。传统基准仅依赖少数任务特定评分,却很少检验嵌入是否仍真实、可解释地反映网络演变。本文将此需求形式化为表示完整性,并推导出一组衡量嵌入变化与图变化匹配程度的指数。通过渐进合并、突变移动、周期重连三种合成场景,对42个候选指数进行筛选,最终推荐一个通过所有理论与实证测试的指数。该指标一致将已知稳定的UASE和IPP模型排在前列。进一步用其对比常见动态图学习模型的表示完整性,揭示神经方法在不同场景下的优势,并显示与单步链接预测AUC存在强正相关性。因此,所提出的完整性框架提供了一种任务无关、可解释的动态图表示质量评估工具,为模型选择与未来架构设计提供了更明确指导。
原文摘要 · Abstract (English)
Real-world systems ranging from airline routes to cryptocurrency transfers are naturally modelled as dynamic graphs whose topology changes over time. Conventional benchmarks judge dynamic-graph learners by a handful of task-specific scores, yet seldom ask whether the embeddings themselves remain a truthful, interpretable reflection of the evolving network. We formalize this requirement as representation integrity and derive a family of indexes that measure how closely embedding changes follow graph changes. Three synthetic scenarios, Gradual Merge, Abrupt Move, and Periodic Re-wiring, are used to screen forty-two candidate indexes. Based on which we recommend one index that passes all of our theoretical and empirical tests. In particular, this validated metric consistently ranks the provably stable UASE and IPP models highest. We then use this index to do a comparative study on representation integrity of common dynamic graph learning models. This study exposes the scenario-specific strengths of neural methods, and shows a strong positive rank correlation with one-step link-prediction AUC. The proposed integrity framework, therefore, offers a task-agnostic and interpretable evaluation tool for dynamic-graph representation quality, providing more explicit guidance for model selection and future architecture design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。