arXiv:2501.03228cs.IRcs.AI2025-01中稿 · WSDM 2025被引 32

轻量级图神经网络,大幅提升推荐系统效率

LightGNN: Simple Graph Neural Network for Recommendation

  • 通过自适应剪枝去除冗余边和嵌入项,压缩模型复杂度
  • 压缩80%边数、90%嵌入项后性能仍接近顶尖模型
  • 适合大规模实时推荐场景,兼顾速度与准确率

图神经网络(GNN)在协同推荐中表现优异,能有效捕捉用户交互模式中的高阶结构信息。然而,在处理大规模、噪声多的真实数据时,现有GNN架构面临可扩展性和鲁棒性挑战。为此,我们提出LightGNN,一种基于知识蒸馏的轻量级图神经网络剪枝框架,显著降低模型复杂度,同时保留关键协作建模能力。该框架引入计算高效的剪枝模块,自适应识别并移除冗余边与嵌入项;其资源友好的分层知识蒸馏目标,通过增强中间层表示来维持性能,尤其在高压缩率下表现突出。在多个公开数据集上的实验表明,LightGNN在实现80%边数减少和90%嵌入项减少的同时,性能仍可媲美更复杂的先进基线模型。代码已开源:https://github.com/HKUDS/LightGNN。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) have demonstrated superior performance in collaborative recommendation through their ability to conduct high-order representation smoothing, effectively capturing structural information within users' interaction patterns. However, existing GNN paradigms face significant challenges in scalability and robustness when handling large-scale, noisy, and real-world datasets. To address these challenges, we present LightGNN, a lightweight and distillation-based GNN pruning framework designed to substantially reduce model complexity while preserving essential collaboration modeling capabilities. Our LightGNN framework introduces a computationally efficient pruning module that adaptively identifies and removes redundant edges and embedding entries for model compression. The framework is guided by a resource-friendly hierarchical knowledge distillation objective, whose intermediate layer augments the observed graph to maintain performance, particularly in high-rate compression scenarios. Extensive experiments on public datasets demonstrate LightGNN's effectiveness, significantly improving both computational efficiency and recommendation accuracy. Notably, LightGNN achieves an 80% reduction in edge count and 90% reduction in embedding entries while maintaining performance comparable to more complex state-of-the-art baselines. The implementation of our LightGNN framework is available at the github repository: https://github.com/HKUDS/LightGNN.

图神经网络推荐系统模型压缩轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。