arXiv:2511.21989cs.IR2025-11

用强化学习选用户历史,让大模型生成更真实的冷启动商品推荐数据。

Selecting User Histories to Generate LLM Users for Cold-Start Item Recommendation

  • 用强化学习训练策略,智能挑选适合生成用户行为的历史数据。
  • 在亚马逊数据集上,冷启动商品召回率显著提升,效果优于随机选用户。
  • 适合需要高效处理新商品推荐的工业级推荐系统场景。

大型语言模型(LLMs)在推理、泛化和模拟人类行为方面表现出色,为改进传统推荐系统(RS)提供了新机遇,尤其在新商品缺乏交互数据的冷启动场景下。现有方法通过数据增强使用LLM生成用户与冷启动商品的交互数据,但存在仅用部分用户历史且随机采样用户的问题,导致生成数据不够真实。为此,本文将LLM视为用户,构建基于强化学习(RL)的框架,训练一个策略模型,根据用户行为特征和历史数据选择最优用户用于数据增强。该策略采用策略梯度方法,优化使冷启动商品推荐性能提升的动作。在Amazon Product Review数据集上的实验表明,该方法显著提升了冷启动商品的召回率,证明其是一种可扩展、服务高效的增强策略。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated remarkable capabilities in reasoning, generalization, and simulating human-like behavior across a wide range of tasks. These strengths present new opportunities to enhance traditional recommendation systems (RS), especially in the cold-start item scenario where newly introduced items lack interactions. Existing works have used LLMs to address cold-start issues in traditional RS through data augmentation, but they have limitations. One recent work directly addresses this issue by prompting LLMs to generate augmented interaction data between randomly sampled users and cold-start items. Then, they train the traditional RS with augmented data, incorporating collaborative signals for cold-start items. Although they use LLMs to provide cold-start items with feedback, they use partial user histories, which does not allow the LLM to fully emulate the user. Furthermore, randomly selecting users is not optimal for augmentation. To address these challenges, we leverage the LLM as a user and develop a reinforcement learning (RL) framework that trains a policy to select users for augmentation, optimizing for cold-start item performance after augmented training. The policy model learns to select users for cold-start item data augmentation based on their behavioral features and histories. To optimize user selection for cold-start item performance, we employ a policy gradient method that updates the policy in the direction of actions that lead to high rewards. Experiments on Amazon Product Review datasets show substantial gains in cold-start item recall, demonstrating the effectiveness of our method as a scalable, serving-efficient augmentation strategy for modern RS.

冷启动推荐大模型强化学习数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。