arXiv:2505.17458cs.LG2025-05被引 1

解决异构图持续学习中遗忘旧知识的问题

HERO: Heterogeneous Continual Graph Learning via Meta-Knowledge Distillation

  • 用元适应快速适应新任务,仅需少量样本
  • 提出新采样方法,保留关键结构与语义信息
  • 适合动态更新的推荐系统和知识图谱场景

异构图神经网络在社交网络、知识图谱和推荐系统等网络应用中发展迅速,源于网络数据的固有异构性。然而现有方法通常假设图结构静态,而现实中的图是持续演化的。这要求模型在适应新数据的同时保留已有知识。为此,本文提出HERO(基于元知识蒸馏的异构持续图学习)框架,用于异构图上的持续学习。HERO采用元适应策略,一种基于梯度的元学习方法,为在少量样本下快速适应新任务提供方向性指导。为实现高效且有效的知识复用,我们提出DiSCo(多样性采样与语义一致性),一种考虑异构性的采样方法,通过沿元路径扩展子图并最大化目标节点多样性,在最小开销下保留关键语义与结构信息。此外,HERO引入异构感知知识蒸馏,在节点和语义层面进行对齐,平衡不同任务间的适应与保留。在四个与网络相关的异构图基准测试上进行的大量实验表明,HERO显著缓解了灾难性遗忘问题,同时在动态网络环境中实现了高效且一致的知识复用。

原文摘要 · Abstract (English)

Heterogeneous graph neural networks have seen rapid progress in web applications such as social networks, knowledge graphs, and recommendation systems, driven by the inherent heterogeneity of web data. However, existing methods typically assume static graphs, while real-world graphs are continuously evolving. This dynamic nature requires models to adapt to new data while preserving existing knowledge. To this end, this work introduces HERO (HEterogeneous continual gRaph learning via meta-knOwledge distillation), a unified framework for continual learning on heterogeneous graphs. HERO employs meta-adaptation, a gradient-based meta-learning strategy that provides directional guidance for rapid adaptation to new tasks with limited samples. To enable efficient and effective knowledge reuse, we propose DiSCo (Diversity Sampling with semantic Consistency), a heterogeneity-aware sampling method that maximizes target node diversity and expands subgraphs along metapaths, retaining critical semantic and structural information with minimal overhead. Furthermore, HERO incorporates heterogeneity-aware knowledge distillation, which aligns knowledge at both the node and semantic levels to balance adaptation and retention across tasks. Extensive experiments on four web-related heterogeneous graph benchmarks demonstrate that HERO substantially mitigates catastrophic forgetting while achieving efficient and consistent knowledge reuse in dynamic web environments.

持续学习异构图知识蒸馏推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。