arXiv:2412.18241cs.IRcs.AI2024-12KDD被引 20

用大模型自动构建推荐图,提升效果且高效。

An Automatic Graph Construction Framework based on Large Language Models for Recommendation

  • 用大模型提取用户偏好和物品知识,生成语义向量
  • 通过向量量化提取潜在因子,作为新节点增强图结构
  • 可兼容多种模型,已在华为广告平台落地见效

图神经网络(GNN)已成为推荐系统中处理图结构数据的前沿方法。然而,现有基于GNN的推荐方法多聚焦于模型结构与学习策略优化,忽视了图构建阶段的重要性。早期图构建依赖特定规则或众包,要么过于简单,要么成本过高。近期工作尝试利用大语言模型(LLM)自动化图构建,凭借其丰富的开放世界知识和推理能力。但普遍面临两大问题:全局视图缺失(如忽略上下文信息)和构建效率低。为此,本文提出AutoGraph——一种基于大模型的自动图构建框架。首先,利用大模型推断用户偏好与物品知识,并编码为语义向量;其次,采用向量量化从语义向量中提取潜在因子,将其作为额外节点连接用户/物品节点,构建具有深层全局语义的图;最后设计基于元路径的消息聚合机制,有效融合语义与协同信息。该框架具备模型无关性,可适配不同主干模型。在三个真实数据集上的实验表明,AutoGraph在性能与效率上均优于基线方法。已在华为广告平台部署,线上A/B测试显示RPM提升2.69%,eCPM提升7.31%。目前作为核心流量模型,服务数亿用户。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) have emerged as state-of-the-art methods to learn from graph-structured data for recommendation. However, most existing GNN-based recommendation methods focus on the optimization of model structures and learning strategies based on pre-defined graphs, neglecting the importance of the graph construction stage. Earlier works for graph construction usually rely on speciffic rules or crowdsourcing, which are either too simplistic or too labor-intensive. Recent works start to utilize large language models (LLMs) to automate the graph construction, in view of their abundant open-world knowledge and remarkable reasoning capabilities. Nevertheless, they generally suffer from two limitations: (1) invisibility of global view (e.g., overlooking contextual information) and (2) construction inefficiency. To this end, we introduce AutoGraph, an automatic graph construction framework based on LLMs for recommendation. Specifically, we first use LLMs to infer the user preference and item knowledge, which is encoded as semantic vectors. Next, we employ vector quantization to extract the latent factors from the semantic vectors. The latent factors are then incorporated as extra nodes to link the user/item nodes, resulting in a graph with in-depth global-view semantics. We further design metapath-based message aggregation to effectively aggregate the semantic and collaborative information. The framework is model-agnostic and compatible with different backbone models. Extensive experiments on three real-world datasets demonstrate the efficacy and efffciency of AutoGraph compared to existing baseline methods. We have deployed AutoGraph in Huawei advertising platform, and gain a 2.69% improvement on RPM and a 7.31% improvement on eCPM in the online A/B test. Currently AutoGraph has been used as the main trafffc model, serving hundreds of millions of people.

图神经网络大模型推荐系统自动构建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。