arXiv:2508.07223cs.IRcs.AI2025-08

从大模型中筛选高质量知识,提升推荐系统性能。

Selection and Exploitation of High-Quality Knowledge from Large Language Models for Recommendation

  • 设计自适应权重网络过滤大模型生成的冗余与幻觉知识。
  • 通过注意力机制对齐大模型语义嵌入与推荐特征空间。
  • 支持灵活训练策略,适合不同推荐场景应用。

近年来,利用大语言模型(LLMs)强大的泛化能力与推理能力来提升推荐系统性能受到广泛关注。然而,不同用户和物品所获取的世界知识常存在幻觉、内容冗余与信息同质化问题。直接将生成的响应嵌入输入推荐模型会导致性能下降。为此,本文提出知识选择与利用推荐框架(KSER),有效筛选并提取高质量知识。该框架包含两个核心组件:知识过滤模块与嵌入空间对齐模块。知识过滤模块设计了嵌入选择滤波网络(ESFNet),为不同知识领域中的知识块分配自适应权重;空间对齐模块提出基于注意力的架构,实现大模型语义嵌入与推荐模型特征空间的对齐。此外,提出了两种训练策略——全参数训练与提取器仅训练,前者灵活适配下游任务,后者为知识增强推荐提供了新视角。实验验证了知识过滤与对齐模块的有效性,并进一步展示了提取器仅训练策略的高效性与有效性。

原文摘要 · Abstract (English)

In recent years, there has been growing interest in leveraging the impressive generalization capabilities and reasoning ability of large language models (LLMs) to improve the performance of recommenders. With this operation, recommenders can access and learn the additional world knowledge and reasoning information via LLMs. However, in general, for different users and items, the world knowledge derived from LLMs suffers from issues of hallucination, content redundant, and information homogenization. Directly feeding the generated response embeddings into the recommendation model can lead to unavoidable performance deterioration. To address these challenges, we propose a Knowledge Selection \& Exploitation Recommendation (KSER) framework, which effectively select and extracts the high-quality knowledge from LLMs. The framework consists of two key components: a knowledge filtering module and a embedding spaces alignment module. In the knowledge filtering module, a Embedding Selection Filter Network (ESFNet) is designed to assign adaptive weights to different knowledge chunks in different knowledge fields. In the space alignment module, an attention-based architecture is proposed to align the semantic embeddings from LLMs with the feature space used to train the recommendation models. In addition, two training strategies--\textbf{all-parameters training} and \textbf{extractor-only training}--are proposed to flexibly adapt to different downstream tasks and application scenarios, where the extractor-only training strategy offers a novel perspective on knowledge-augmented recommendation. Experimental results validate the necessity and effectiveness of both the knowledge filtering and alignment modules, and further demonstrate the efficiency and effectiveness of the extractor-only training strategy.

知识推荐大模型推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。