arXiv:2501.15696cs.LG2025-01被引 1

用双曲空间优化随机游走,提升图蒸馏的几何表达与持续学习能力

Random Walk Guided Hyperbolic Graph Distillation

  • 在双曲空间中建模图结构,更贴合真实网络的树状几何特征
  • 在节点分类和链接预测任务上超越现有方法,持续学习性能提升显著
  • 保留随机游走特性,适合隐私保护与抗噪场景下的图学习应用

图蒸馏(GD)是一种从大规模网络结构中提取有用信息的有效方法。然而,现有方法在欧氏空间中生成压缩图,难以捕捉真实网络固有的树状几何特征,导致蒸馏图在下游任务中任务特定信息有限。此外,这些方法通常无法提取图的动态属性,而动态属性对于理解信息传播和实现图的持续学习至关重要。本文提出一种新的图蒸馏方法——基于随机游走优化的双曲图蒸馏(HyDRO),利用双曲嵌入捕捉复杂几何模式,并在双曲空间中优化谱间隙。实验表明,HyDRO在节点分类和链接预测任务中均展现出强大的任务泛化能力,持续领先于当前最优方法。同时,HyDRO有效保留了图的随机游走特性,生成的压缩图在持续图学习中表现更优。此外,该方法在主流图蒸馏基准上取得有竞争力的结果,同时在隐私与效用之间保持良好平衡,并表现出对噪声的强鲁棒性。

原文摘要 · Abstract (English)

Graph distillation (GD) is an effective approach to extract useful information from large-scale network structures. However, existing methods, which operate in Euclidean space to generate condensed graphs, struggle to capture the inherent tree-like geometry of real-world networks, resulting in distilled graphs with limited task-specific information for downstream tasks. Furthermore, these methods often fail to extract dynamic properties from graphs, which are crucial for understanding information flow and facilitating graph continual learning. This paper presents the Hyperbolic Graph Distillation with Random Walks Optimization (HyDRO), a novel graph distillation approach that leverages hyperbolic embeddings to capture complex geometric patterns and optimize the spectral gap in hyperbolic space. Experiments show that HyDRO demonstrates strong task generalization, consistently outperforming state-of-the-art methods in both node classification and link prediction tasks. HyDRO also effectively preserves graph random walk properties, producing condensed graphs that achieve enhanced performance in continual graph learning. Additionally, HyDRO achieves competitive results on mainstream graph distillation benchmarks, while maintaining a strong balance between privacy and utility, and exhibiting robust resistance to noises.

图蒸馏双曲空间持续学习随机游走

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。