轻量图推荐新方法,参数减少99%仍保持高性能
Lighter-X: An Efficient and Plug-and-play Strategy for Graph-based Recommendation through Decoupled Propagation
- 分离传播机制,压缩稀疏邻接与高维嵌入矩阵
- 参数复杂度从O(n×d)降至O(h×d),h远小于n
- 适合大规模图推荐系统部署,兼容现有模型
图神经网络在推荐系统中表现优异,但传统方法如LightGCN需为每个节点维护大小为d的嵌入,导致参数复杂度为O(n×d),难以在真实大规模图上部署。为此,我们提出Lighter-X,一种高效且可插拔的框架,能无缝集成至现有GNN推荐架构。通过分析原始结构中的冗余,我们设计了一种高效的稀疏邻接结构与高维嵌入矩阵压缩方案,将参数复杂度降至O(h×d),其中h≪n。同时,采用解耦训练框架降低计算开销,提升可扩展性。大量实验表明,Lighter-X在参数量显著减少的情况下仍保持接近基线模型的性能;在包含数百万条边的大规模交互图上,仅用1%的参数即优于LightGCN。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have demonstrated remarkable effectiveness in recommendation systems. However, conventional graph-based recommenders, such as LightGCN, require maintaining embeddings of size $d$ for each node, resulting in a parameter complexity of $\mathcal{O}(n \times d)$, where $n$ represents the total number of users and items. This scaling pattern poses significant challenges for deployment on large-scale graphs encountered in real-world applications. To address this scalability limitation, we propose \textbf{Lighter-X}, an efficient and modular framework that can be seamlessly integrated with existing GNN-based recommender architectures. Our approach substantially reduces both parameter size and computational complexity while preserving the theoretical guarantees and empirical performance of the base models, thereby enabling practical deployment at scale. Specifically, we analyze the original structure and inherent redundancy in their parameters, identifying opportunities for optimization. Based on this insight, we propose an efficient compression scheme for the sparse adjacency structure and high-dimensional embedding matrices, achieving a parameter complexity of $\mathcal{O}(h \times d)$, where $h \ll n$. Furthermore, the model is optimized through a decoupled framework, reducing computational complexity during the training process and enhancing scalability. Extensive experiments demonstrate that Lighter-X achieves comparable performance to baseline models with significantly fewer parameters. In particular, on large-scale interaction graphs with millions of edges, we are able to attain even better results with only 1\% of the parameter over LightGCN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。