arXiv:2605.18771cs.IR2026-05

用拉格朗日约束实现个性化知识注入,提升生成式推荐效果

LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation

论文配图:LWGR: Lagrangian-Constrained Personalized World Knowledge for Generative Recommendation
图 1 · 摘自论文原文
  • 通过个性化软指令从LLM提取用户相关知识
  • 采用拉格朗日方法控制知识融合,性能下降不超过1.35%
  • 适合大规模工业推荐系统,兼顾效果与效率

基于大语言模型的生成式推荐虽能利用世界知识提升性能,但现有方法依赖固定指令,难以捕捉用户兴趣多样性,且知识融合可能干扰行为信号。为此,本文提出LWGR框架,利用拉格朗日约束将用户个性化世界知识引入生成式推荐。该框架在知识提取与融合两方面优化:构建个性化软指令以提取行为相关知识,并将知识融合建模为带性能上限的优化问题,通过拉格朗日对偶法选择性融合有益知识。针对不同规模的LLM设计两种训练策略,结合近线预计算与轻量在线服务的部署方案。在多个公开数据集及一个工业数据集上的实验表明,LWGR超越8个先进基线最多11.23%,并在大规模广告平台带来1.35%的收入提升,验证了其有效性与实用性。

原文摘要 · Abstract (English)

Recent progress in large language model (LLM) based generative recommendation (GR) shows that leveraging LLM world knowledge can substantially improve performance. However, existing methods rely on fixed, manually designed instructions to generate semantic knowledge and directly incorporate it into GR, which has two limitations. First, fixed instructions cannot capture the multidimensional heterogeneity of user interests. Second, uncontrollable knowledge fusion may conflict with behavioral signals and harm recommendations. To address these limitations, we propose LWGR, a framework that leverages Lagrangian constraints to transfer users' personalized world knowledge from LLMs into generative recommendation. LWGR enhances GR along two axes: knowledge extraction and fusion. It builds personalized soft instructions to extract behavior-relevant LLM world knowledge, and formulates knowledge fusion as an optimization problem with explicitly bounded performance degradation, which is solved by a Lagrangian primal-dual method to selectively incorporate beneficial knowledge. We further design two training strategies for different LLM scales and a deployment scheme that combines nearline precomputation with lightweight online serving. Experiments on multiple public datasets and one industrial dataset show that LWGR outperforms eight state-of-the-art baselines by up to 11.23% and brings a 1.35% revenue lift on a large-scale advertising platform, demonstrating its effectiveness and practicality.

生成式推荐大模型个性化知识融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。